Wearable device for providing payment information

ABSTRACT

The present invention relates to a payment information providing system using a wearable device, and more specifically, the payment information providing system includes: a wearable device for recognizing and photographing a product image by sensing a motion of a user and transferring the photographed product image to a product information providing device, and receiving product information transferred from the product information providing device and displaying the product information on a screen; the product information providing device for receiving the product image from the wearable device and providing information on a product related to the product image to the wearable device; and a contents providing server for receiving the product information from the product information providing device and transferring digital contents to the wearable device if a product to be purchased is selected according to the received product information.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is continuation of U.S. patent application Ser.No. 15/331,474 filed on Oct. 21, 2016, which claims the benefit ofKorean Patent Application No. 10-2015-0148975 filed in the KoreanIntellectual Property Office on Oct. 26, 2015, Korean Patent ApplicationNo. 10-2015-0150318 filed in the Korean Intellectual Property Office onOct. 28, 2015 and Korean Patent Application No. 10-2015-0150981 filed inthe Korean Intellectual Property Office on Oct. 29, 2015, the entirecontents of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION Field of the Invention

The present invention relates to a payment information providing systemusing a wearable device and a payment information providing method usingthe same, and more specifically, to a technique of recognizing a producton a display stand using a wearable device such as a smart glass,creating product information corresponding to an image of the recognizedproduct, and providing a related contents service.

Background of the Related Art

A wearable device is literally a device that can be put on a human body,and there are various kinds of wearable devices according to wearingportions, such as glasses, a watch, shoes, a ring, a belt, a band, anecklace, a headset, clothes and the like. Such wearable devices arecurrently in a rapidly distributed stage, and among them, wearableglasses, wearable watches and wearable bands closely related to humanlife and, at the same time, easy to wear form largest product groups.

On the other hand, the wearable device is also referred to as a smartdevice in other words. It is since that although initiation of operationby an input of a user is needed, if once the operation is initiated,various kinds of additional information can be automatically created andprovided to the user thereafter. For example, if a user wearing awearable watch desires to measure his or her heart rate, the wearablewatch measures the heart rate of the user as soon as the user presses aheart rate measurement input button and creates and provides variouskinds of information to the user based on the measured heart rate.Meanwhile, a lot of wearable devices which do not need initiation ofoperation by an input of a user also appear recently. For example, awearable band may continuously measure a heart rate of a user althoughthere is no initiation of operation by an input of a user, and it ishighly probable that wearable devices of the future will be developed ina direction that does not need initiation of operation by an input of auser. It is since that convenience of operating a device will beincreased as the input of a user is not needed.

The source of various kinds of additional information provided by thewearable device to a user is information measured from the user. Forexample, it is information such as a heartbeat rate, a blood pressure, amental state, a weight, a body temperature, a respiration volume, thenumber of steps, interest, a current position and the like of the user.Accordingly, the wearable device should necessarily install sensors formeasuring a variety of information from the user, and the more the kindsof installed sensors, the more information can be measured from theuser. Accordingly, recent wearable devices tend to necessarily install aheart rate measurement sensor, a global positioning system (GPS) sensorand a step count measurement sensor, and studies on installing variouskinds of sensors in the limited inner space of a device are progressedcontinuously.

After measuring such information from the user through the installedsensors, the wearable device may create various kinds of additionalinformation based on the information and provide the user with theinformation. For example, the wearable device may measure blood pressureof a user and provide, if the blood pressure is too high, information onmedicines which can drop the blood pressure to an appropriate level ormay measure the current position of the user and provide information onnearby stores or products related to the interest of the user. Althoughthe additional information can be provided through a function of thewearable device itself, since all the additional information needed fordifferent users cannot be provided through one wearable device,applications installed in the wearable device are developed togetherrecently. Here, an application can be regarded as a kind of applicationprogram and may perform a function of creating and providing variouskinds of additional information based on the information measuredthrough a function of the wearable device itself.

In the above example, all the information on medicines which can dropthe blood pressure to an appropriate level and information on the nearbystores or products related to the interest of the user can be providedby the application. That is, whenever a new application is developed,additional information that can be provided to the user through thewearable device is necessarily diversified, and thus development ofapplications can be regarded as a companion to go forward together withdevelopment of the wearable device itself.

Meanwhile, construction of a system capable of providing digitalcontents or making a payment through a wearable device emerges as a mainissue in the related industries recently.

For example, although a user does not take out his or her wallet andmake a payment, the user may make a payment using digital contentspresented through a wearable device by installing a near fieldcommunication (NFC) function in the wearable device itself andregistering a credit card and authentication information of the user inan application. That is, the wearable device may perform a mobile walletfunction on behalf of the conventional wallets.

Meanwhile, a general service system for providing product informationand payment information related to the product information using a smartphone is constructed already.

However, when the product information and the payment information arecreated in a conventional system, there is a problem in that userscannot use the system properly since the speed and convenience areinsufficient to immediately recognize the products displayed in a storeand perform a service for providing payment information associated withdigital contents in real-time.

Accordingly, a system and a method utilizing the same are proposed inthis specification, which can solve the problem of speed and convenienceby way of a service of providing payment information through a wearabledevice and, at the same time, provide users with further efficientservices in association with digital contents providing service.

SUMMARY OF THE INVENTION

Therefore, the present invention has been made in view of the aboveproblems, and it is an object of the present invention to provide aservice for providing product information and payment information inreal-time by immediately recognizing a product image.

Another object of the present invention is to provide a serviceassociated with digital contents in real-time by using productinformation corresponding to a product image.

Accordingly, proposed in this specification is a service capable ofsolving the problem of convenience and security of payment in making apayment through a wearable device and, at the same time, receivinginformation on coupons, points or events that can be used at a storewhere a user is going to make a payment from a product informationproviding device by recognizing, without a physical input, a motion ofthe user for making a payment.

An object of the present invention is to receive information on coupons,points or events that can be used can be used at a store where a user isgoing to make a payment without a physical input, by sensing a paymentmotion of the user.

An object of the present invention is to provide a system and method forproviding benefit information for an interested product, which cancollect information on a product reviewed by a user with interest, aswell as a product actually purchased by the user, and actually providethe user with information on the interested product based on thecollected information.

Another object of the present invention is to provide a system andmethod for providing benefit information for an interested product,which can register the interested product on the basis of exposure timeof an object identified by an image acquired through a wearable device.

Still another object of the present invention is to provide a system andmethod for providing benefit information for an interested product,which can recommend benefit information of the products belonging to acategory of a product registered as an interested product.

Another object of the present invention is to provide a custom-tailoredproduct to the user by inversely using the information collected usingthe wearable device and provide a digital contents service associatedwith the product. Meanwhile, the technical problems to be solved by thepresent invention are not limited to those mentioned above, and diversetechnical problems may be included within the scope clearly understoodby those skilled in the art from the following descriptions.

To accomplish the above objects, according to one aspect of the presentinvention, there is provided a payment information providing systemusing a wearable device, the system including: the wearable device forrecognizing and photographing a product image by sensing a motion of auser and transferring the photographed product image to a productinformation providing device, and receiving product informationtransferred from the product information providing device and displayingthe product information on a screen; the product information providingdevice for receiving the product image from the wearable device andproviding information on a product related to the product image to thewearable device; and a contents providing server for receiving theproduct information from the product information providing device andtransferring digital contents to the wearable device if a product to bepurchased is selected according to the received product information.

Meanwhile, the payment information providing system may further includea membership connection device for performing authentication accordingto authentication information transferred from the contents providingserver, transferring membership information of the user to the contentsproviding server if it is confirmed that the user is a membership holderas a result of the authentication, and transmitting a membershipacquisition request message to the contents providing server and thewearable device if it is confirmed that the user is not a membershipholder.

A wearable device of the present invention includes: a motion sensingunit for sensing a motion of a user; a camera module for recognizing andphotographing a product image; an image storage unit for storing aproduct image data of the product image photographed by the cameramodule; an image data transmission unit for transferring the productimage data stored in the image storage unit to a product informationproviding device; a product information data reception unit forreceiving product information transferred from the product informationproviding device; and a display unit for displaying the productinformation data received by the product information data reception uniton a screen.

Meanwhile, the product information data reception unit may furtherreceive digital contents transferred from a contents providing server ifa product to be purchased is selected according to the productinformation, and the display unit may display payment information of theproduct reflecting the digital contents received by the productinformation data reception unit on a screen.

At this point, the motion of the user sensed by the motion sensing unitmay be an eyeline of the user gazing at a product or a preset gestureperformed on the product that the user is gazing at.

At this point, if the motion of the user sensed by the motion sensingunit matches a preset motion, the camera module may recognize andphotograph the product.

A product information providing device of the present inventionincludes: a data reception unit for receiving a digital contentsinformation data or a product image data; a product image database forstoring image data of products displayed in a store; a product imagematching unit for determining whether or not the product image datareceived from a wearable device by the data reception unit matches aproduct image data previously stored in the product image database; aproduct information providing module for providing information on amatching product if it is determined by the product image matching unitthat the product image data of a store stored in the product imagedatabase matches the product image data received from a wearable device;and a product information data transmission unit for transferringproduct information data provided by the product information providingmodule to the wearable device.

Meanwhile, the product information data transmission unit may furthertransfer the product information data provided by the productinformation providing module to a contents providing server.

The product information providing module of the present inventionincludes: a product classification unit for classifying, by category, atype of a product corresponding to the product image data determined asbeing matched by the product image matching unit; a product informationcreation unit for creating a product information data of the productclassified by category by the product classification unit; and a productdata providing unit for transferring the product information data of theproduct created by the product information creation unit to the productinformation data transmission unit.

At this point, the product information data of the product created bythe product information creation unit may include at least any one ofinformation on a specification of the product, price information, amanufacturing date, a manufacturer and a product provided as a bundle.

At this point, the product information creation unit may additionallycreate a product information data for a product of the same kind as theproduct classified by the product classification unit.

At this point, the product information creation unit may create theproduct information data by reflecting the digital contents informationdata transferred from the contents providing server.

The contents providing server of the present invention includes: aproduct information reception unit 310 for receiving product informationfrom the product information providing device; a digital contentsproviding unit for transferring digital contents related to the productinformation received by the product information reception unit 310 to adigital contents transmission unit; and the digital contentstransmission unit for transferring the digital contents transferred fromthe digital contents providing unit to the wearable device.

Meanwhile, the contents providing server of the present invention mayfurther include an authentication information transmission unit fortransferring authentication information to the membership connectiondevice to confirm whether or not a user holds membership of anaffiliated company or a product service provider related to the digitalcontents transferred from the digital contents providing unit to thewearable device.

The membership connection device of the present invention includes: amembership holder authentication performing unit for performingauthentication according to the authentication information transferredfrom the contents providing server; a membership informationtransmission unit for transferring membership information of the user tothe contents providing server if it is confirmed that the user is amembership holder as a result of the authentication of the membershipholder authentication performing unit; a membership acquisition requesttransmission unit for transmitting a membership acquisition requestmessage to the wearable device if it is confirmed that the user is not amembership holder as a result of the authentication of the membershipholder authentication performing unit; and a membership acquisitionapproval message reception unit for receiving a membership acquisitionapproval message transmitted from the wearable device in response to themembership acquisition request message.

A method of providing payment information by a payment informationproviding system includes the steps of: (1) recognizing andphotographing, by a wearable device, a product image by sensing a motionof a user; (2) receiving, by a product information providing device, theproduct image photographed at step (1) and determining whether or notthe product image matches a product image data previously stored in aproduct image database; (3) providing an information data of a matchingproduct if the product image data is matched at step (2); and (4)receiving, by a contents providing server, the product information fromthe product information providing device and transferring digitalcontents to the wearable device according to the received productinformation.

Meanwhile, the method of providing payment information by a paymentinformation providing system may further include, after step (3) andbefore step (4), the steps of: (a) confirming, by a membershipconnection device, whether or not a user holds membership of anaffiliated company which provides digital contents using authenticationinformation of the service user subscribing a payment informationproviding service; (b) transferring, by a membership connection device,membership information of the user to the contents providing server ifit is confirmed that the user is a membership holder at step (a), andtransferring a membership acquisition request message to the contentsproviding server and the wearable device if it is confirmed that theuser is not a membership holder at step (a); and (c) transferring themembership information of the user to the contents providing server if amembership acquisition approval message is transferred from the wearabledevice in response to the membership acquisition request messagetransferred at step (b).

A method of providing payment information by a wearable device includes:(1) a motion sensing step of sensing a motion of a user; (2) a step ofrecognizing and photographing a product image according to the motionrecognized at step (1); (3) an image storage step of storing a productimage data of the product image photographed at step (2); (4) aninformation transmission step of transferring the product image datastored at step (3) to a product information providing device; (5) a datareception step of receiving product information corresponding to theproduct image data transferred at step (4); and (6) a display step ofdisplaying the product information data received at step (5).

A method of providing payment information by a product informationproviding device includes the steps of: (1) a data reception step ofreceiving a digital contents information data and a product image data;(2) a step of determining whether or not a product image data of avisited store previously stored in a product image database matches theproduct image data received at step (1); (3) a product informationproviding step of providing, if it is determined at step (2) that theproduct image data of a store stored in the product image databasematches the product image data received from a wearable device, aninformation data of a matching product; and (4) a data transmission stepof transferring the product information data provided at step (3) to thewearable device.

At this point, step (3) may include: (a) a product classification stepof classifying, by category, a type of a product corresponding to theproduct image data determined as being matched at step (2); (b) aproduct information creation step of creating a product information dataof the product classified by category at step (a); and (c) a productdata providing step of transferring the information data of the productcreated at step (b) to a product information data transmission unit.

A method of providing payment information by a contents providing serverincludes: (1) a product information reception step of receiving productinformation from a product information providing device; (2) a digitalcontents providing step of transferring digital contents related to theproduct information received at step (1) to a digital contentstransmission unit; and (3) a digital contents transmission step oftransferring the digital contents transferred at step (2) to a wearabledevice.

Meanwhile, the method of providing payment information by a contentsproviding server may further include, after step (2) and before step(3), an authentication information transmission step of transferringauthentication information to a membership connection device 400 toconfirm whether or not a user holds membership of an affiliated companyor a payment information provider related to the digital contents.

A method of providing payment information by a membership connectiondevice includes: (1) a membership holder authentication performing stepof performing authentication according to authentication informationtransferred from a contents providing server; (2) a step of transferringmembership information of a user to the contents providing server if itis confirmed that the user is a membership holder as a result of theauthentication at step (1) and transmitting a membership acquisitionrequest message to a wearable device if it is confirmed that the user isnot a membership holder; and (3) a membership acquisition approvalmessage receiving step of receiving a membership acquisition approvalmessage transmitted from the wearable device in response to themembership acquisition request message transmitted at step (2).

Meanwhile, ‘a system and method for providing payment information usinga wearable device’ described above may be implemented in the form of aprogram and recorded in a recording medium that can be read by anelectronic device or distributed through a program download managementdevice (a server or the like).

A system for providing coupons and points by sensing a payment motionaccording to the present invention may include: a wearable device forstoring one or more payment motions of a user, sensing a motion of theuser, grasping whether or not the sensed motion of the user matches thestored payment motion, and requesting information on coupons, points orevents that can be used at a store where the user is positioned from aproduct information providing device if the motions are matched; and aproduct information providing device for storing the information oncoupons, points or events that can be used at a store, extractinginformation on coupons, points or events that can be used at a storewhere the user is positioned, and transmitting the extracted informationto the wearable device in response to a request from the wearabledevice.

In addition, the system of the present invention for providing couponsand points by sensing a payment motion may further include a beacon forsensing approach of the wearable device and transmitting positioninformation of a store to the wearable device approached within apredetermined distance, and the wearable device transmits the positioninformation of the store received from the beacon to the productinformation providing device and receives information on coupons, pointsor events that can be used at the sore from the product informationproviding device.

In addition, the system of the present invention for providing couponsand points by sensing a payment motion may further include a userterminal for receiving information on coupons, points or events from theproduct information providing device and making a mobile payment byreflecting the information on coupons, points or events.

A wearable device for providing coupons and points by sensing a paymentmotion according to the present invention may include: a motion storageunit for storing one or more payment motions of a user; a motion sensingunit for sensing a motion of the user; and a control unit for graspingwhether or not the sensed motion of the user matches the stored paymentmotion and, if the motions are matched, requesting information oncoupons, points or events that can be used at a store where the user ispositioned from a product information providing device.

In addition, the motion sensing unit may use an electromyography sensorfor sensing an electrical signal of a muscle changing according to amotion of the user.

In addition, the motion sensing unit may use an inertial sensor forsensing an acceleration changing according to a motion of the user.

At this point, the motion sensing unit senses a motion of the userholding a card or bills, and the control unit creates a payment signalaccording to the sensed motion.

In addition, the wearable device of the present invention for providingcoupons and points by sensing a payment motion may further include acommunication unit for transmitting a signal created by the control unitto the product information providing device together with GPSinformation and receiving information on coupons, points or events ofthe store based on the GPS information from the product informationproviding device.

At this point, the communication unit receives position information ofthe store from a beacon, transmits the position information of the storereceived from the beacon to the product information providing device,and receives information on coupons, points or events that can be usedat the store from the product information providing device.

In addition, the control unit grasps whether or not the motion of theuser sensed by the motion sensing unit matches the payment motion, andif the motions are matched, the control unit makes a payment bytransmitting payment information of the user reflecting the receivedinformation on coupons, points or events to an external device.

A product information providing device of the present invention mayinclude: a database for storing information on coupons, points or eventsthat can be used at a store; a server control unit for extractinginformation corresponding to a signal received from a wearable devicefrom the database; and a server communication unit for transmitting thecorresponding information to the wearable device or a user terminal.

A method of making a payment by sensing a motion according to thepresent invention includes the steps of: (a) sensing, by a wearabledevice, a motion of a user; (b) comparing, by the wearable device, themotion of the user with a previously stored motion and creating a signalset to execute a command corresponding to a previously stored paymentmotion; (c) transmitting, by the wearable device, the signal to aproduct information providing device and receiving, by a managementserver, the signal; (d) extracting, by the product information providingdevice, information corresponding to the received signal; (e)transmitting, by the product information providing device, the extractedinformation to the wearable device and receiving, by the wearabledevice, the extracted information; and (f) making a payment, by thewearable device, by transmitting payment information of the userreflecting the received information to an external device.

In addition, the method of making a payment by sensing a motionaccording to another embodiment of the present invention may furtherinclude, before step (c), the step of receiving, by the wearable device,position information of the store from the beacon, and at step (c), thereceived position information of the store is also transmitted to theproduct information providing device.

In addition, the method of making a payment by sensing a motion mayfurther include, after step (d), the steps of: (d1) transmitting, by themanagement server, the extracted information to a user terminal andreceiving, by the user terminal, the information; and (d2) making, bythe user terminal, a payment by transmitting the payment information ofthe user reflecting the received information to an external device.

In a method of making a payment by sensing a motion by a wearable deviceof the present invention, the method of making a payment by sensing amotion includes the steps of: (a) storing one or more payment motions ofa user; (b) sensing a motion of the user; (c) grasping whether or notthe sensed motion of the user matches the stored payment motion; and (d)requesting, if the sensed motion of the user matches the stored paymentmotion, information on coupons, points or events that can be used at astore where the user is positioned from a product information providingdevice.

In addition, step (d) may include the steps of: (d1) transmitting, ifthe sensed motion of the user matches the stored payment motion, thecreated payment signal to the product information providing devicetogether with GPS information; and (d2) receiving information oncoupons, points or events based on the GPS information from the productinformation providing device.

In addition, the method of making a payment by sensing a motion mayfurther include the step of: (e) receiving position information of thestore from a beacon, and step (d) may include the steps of: (d3)transmitting the position information of the store to the productinformation providing device; and (d4) receiving information on coupons,points or events that can be used at the store from the productinformation providing device.

Meanwhile, at step (b), the wearable device may use an electromyographysensor for sensing an electrical signal of a muscle changing accordingto a motion of the user.

In addition, at step (b), the wearable device may use an inertial sensorfor sensing an acceleration changing according to a motion of the user.

In a method of making a payment by sensing a motion by a productinformation providing device of the present invention, the method ofmaking a payment by sensing a motion may include the steps of: (a)storing information on coupons, points or events that can be used at astore; (b) extracting information corresponding to a signal receivedfrom a wearable device; and (c) transmitting the correspondinginformation to the wearable device or a user terminal.

According to an aspect of the present invention, there is provided awearable device including: an image acquisition unit for acquiring animage; a display unit for displaying the acquired image; a motionsensing unit for sensing a motion of a user; and a control unit foridentifying, if the sensed motion of the user is a preset motion, anobject from the displayed image, registering the identified object as aninterested product, and receiving benefit information corresponding to acategory where the interested product belongs to.

The control unit may measure an exposure time of the object displayed onthe display unit and register the object as an interested product if themeasured exposure time is longer than a preset time.

In addition, the control unit may extract product identificationinformation by scanning the object, transmit the product identificationinformation to a product information providing device, and receivebenefit information corresponding to a category where the productidentification information belongs to from the product informationproviding device.

In addition, the control unit may transmit an image of the object to theproduct information providing device and receive benefit informationcorresponding to a category where the image of the object belongs tofrom the product information providing device.

The motion sensing unit may sense the eyeline of the user gazing at anobject or movement of a body performed on the object that the user isgazing at as a motion of the user.

According to another aspect of the present invention, there is provideda product information providing device including: a communication unitfor communicating with a wearable device through a communicationnetwork; and a personalized service unit for providing, if interestedproduct information is received from the wearable device through thecommunication unit, the wearable device with benefit information of theproducts belonging to the category of a corresponding product.

If interested product information including an exposure time and productidentification information is received from the wearable device, thepersonalized service unit may confirm a category where the productidentification information belongs to and provide the wearable devicewith benefit information of the products belonging to the confirmedcategory.

In addition, if interested product information including an exposuretime and product identification information is received from thewearable device, the personalized service unit may extract the productidentification information by analyzing the object image, confirm acategory where the product identification information belongs to, andprovide the wearable device with benefit information of the productsbelonging to the confirmed category.

The product information providing device may further include a databasefor storing information on the products by category.

According to still another aspect of the present invention, in a methodof providing benefit information for an interested product by a wearabledevice, there is provided a method of providing benefit information foran interested product, the method including the steps of: (a)recognizing an image corresponding to a view of a user and sensing amotion of the user; (b) identifying an object from the recognized imageif the sensed motion of the user is a preset motion; and (c) registeringthe identified object as an interested product and receiving benefitinformation corresponding to a category where the interested productbelongs to.

Step (c) may include the steps of: measuring an exposure time of theobject; extracting product identification information by scanning theobject if the measured exposure time is longer than a preset time;determining a category of an interested product corresponding to theproduct identification information; and receiving benefit informationcorresponding to the determined category.

Meanwhile, the ‘method of providing benefit information for aninterested product’ may be implemented in the form of a program andrecorded in a recording medium that can be read by an electronic deviceor distributed through a program download management device (a server orthe like).

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a view schematically showing a payment information providingsystem using a wearable device according to an embodiment of the presentinvention.

FIG. 2 is a view showing an example of recognizing and photographing aproduct image following the eyeline of a user by a wearable deviceaccording to an embodiment of the present invention.

FIG. 3 is a view showing an example of selecting an interested productfollowing a gesture of a user by a wearable device according to anembodiment of the present invention.

FIG. 4 is a view showing an example of providing payment information bya payment information providing system according to an embodiment of thepresent invention.

FIG. 5 is a block diagram showing the configuration of a wearable deviceaccording to an embodiment of the present invention.

FIG. 6 is a block diagram showing the configuration of a productinformation providing device according to an embodiment of the presentinvention.

FIG. 7 is a block diagram showing the configuration of a productinformation providing module according to an embodiment of the presentinvention.

FIG. 8 is a block diagram showing the configuration of a contentsproviding server according to an embodiment of the present invention.

FIG. 9 is a block diagram showing the configuration of a membershipconnection device according to an embodiment of the present invention.

FIG. 10 is a sequence diagram illustrating a payment informationproviding method using a wearable device according to an embodiment ofthe present invention.

FIG. 11 is a sequence diagram illustrating a method of providing paymentinformation by performing an authentication process using a membershipconnection device according to another embodiment of the presentinvention.

FIG. 12 is a configuration view showing the functional blocks of asystem for providing coupons and points by sensing a payment motionaccording to an embodiment of the present invention.

FIG. 13 is a configuration view showing the functional blocks of awearable device for providing coupons and points by sensing a paymentmotion according to an embodiment of the present invention.

FIG. 14 is a configuration view showing the functional blocks of aproduct information providing device according to an embodiment of thepresent invention.

FIG. 15 is a sequence diagram illustrating a method of making a paymentby sensing a motion according to an embodiment of the present invention.

FIG. 16 is a flowchart illustrating a method of providing coupons andpoints by sensing a payment motion in a wearable device according to anembodiment of the present invention.

FIG. 17 is a flowchart illustrating a method of providing coupons andpoints by sensing a payment motion in a wearable device according toanother embodiment of the present invention.

FIG. 18 is a flowchart illustrating a method of providing coupons andpoints by sensing a payment motion in a product information providingdevice according to an embodiment of the present invention.

FIG. 19 is a view showing a system for providing benefit information foran interested product according to an embodiment of the presentinvention.

FIG. 20 is a view showing an example of implementing a wearable deviceas a smart glass according to an embodiment of the present invention.

FIG. 21 is a view showing an example of implementing a wearable deviceas a smart watch according to an embodiment of the present invention.

FIG. 22 is a block diagram schematically showing the configuration of awearable device according to an embodiment of the present invention.

FIG. 23 is a block diagram schematically showing the configuration of aproduct information providing device according to an embodiment of thepresent invention.

FIG. 24 is a flowchart illustrating a method of receiving benefitinformation for an interested product by a wearable device according toanother embodiment of the present invention.

FIG. 25 is a flowchart illustrating a method of providing benefitinformation for an interested product according to an embodiment of thepresent invention.

FIG. 26 is a flowchart illustrating a method of providing benefitinformation for an interested product according to another embodiment ofthe present invention.

DESCRIPTION OF SYMBOLS

-   -   100: Wearable device    -   110: Motion sensing unit    -   120: Camera module    -   130: Image data transmission unit    -   140: Product information data reception unit    -   150: Display unit    -   200: Product information providing device    -   210: Data reception unit    -   220: Product image database    -   230: Product image matching unit    -   240: Product information providing module    -   241: Product classification unit    -   242: Product information creation unit    -   100′: Smart device    -   110′: Camera unit    -   120′: Identification information extraction unit    -   130′: Communication unit    -   140′: Display unit    -   150′: Biometric information measurement unit    -   160′: Input unit    -   200′: Management device    -   210′: Database    -   220′: Identification information matching unit    -   230′: Food recommendation unit    -   240′: Management device communication unit    -   300′: User device    -   100″: Wearable device    -   110″: Image acquisition unit    -   120″: Motion sensing unit    -   130″, 240′: Control unit    -   140″: Display unit    -   150″: Storage unit    -   160″, 220″: Communication unit    -   200″: Product information providing device    -   210″: Database    -   230″: Personalized service unit

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

Hereinafter, ‘a payment information providing system using a wearabledevice 100 and a service providing method using the same’ according tothe present invention will be described in detail with reference to theaccompanying drawings. The disclosed embodiments are provided to enablethose skilled in the art to easily understand the scope of the presentinvention, and the present invention is not limited by such embodiments.Moreover, matters illustrated in the drawings are schematized in orderto describe or explain the embodiments of the present invention moreeasily and hence may be different from actually embodied forms.

Meanwhile, the constitutional components expressed below are merelyexamples for implementing the present invention. Accordingly, otherconstitutional components may be used in other implementations of thepresent invention without departing from the spirit and scope of thepresent invention.

In addition, although each constitutional component may be implementedonly in a pure hardware or software configuration, it also can beimplemented by combining various hardware or software configurationsperforming the same function. In addition, two or more constitutionalcomponents may be implemented together by one-piece of hardware orsoftware.

In addition, the expression of ‘including’ a component is an expressionof an ‘open type’ which merely refers to existence of a correspondingcomponent, and it should not be construed as precluding additionalcomponents.

Hereinafter, the present invention is described in detail with referenceto the drawings.

FIG. 1 is a view schematically showing a payment information providingsystem using a wearable device 100 according to an embodiment of thepresent invention.

At this point, the wearable device 100, a product information providingdevice 200, a contents providing server 300, and a membership connectiondevice 400 are connected through a wired and wireless communicationnetwork, and at this point, the communication network includes a basestation controller, a base station transmitter and/or a relay. Here, thebase station controller performs a function of relaying signals betweenthe base station transmitter and a switching center. The communicationnetwork supports both synchronous and asynchronous types. Accordingly,in the case of the synchronous type, the transmitter of a transmissionand reception base station will be a Base Station Transmission System(BTS), and the controller of the transmission and reception base stationwill be a Base Station Controller (BSC), whereas in the case of theasynchronous type, the transmitter of a transmission and reception basestation will be a Radio Transceiver Subsystem (RTS), and the controllerof the transmission and reception base station will be a Radio NetworkController (RNC). It is apparent that the communication networkaccording to an embodiment of the present invention is not limitedthereto, and it generally refers to a GSM network, not a CDMA network,and any one that can be used in an access network of a next-generationmobile communication system which will be implemented in the future.

The communication network may further include access points. The accesspoint is a small base station such as a femto or pico base stationfrequently installed inside a building. Here, the femto or pico basestation is categorized by the maximum number of servers and devicesbased on the classification of small base stations. In addition, theaccess point includes a short-range communication module for performingshort-range communication with a portable terminal, such as Wi-Ficommunication or the like. The short-range communication can beperformed based on various specifications of Bluetooth communication,Zigbee communication, infrared communication (IrDA), Radio Frequency(RF) communication including Ultra High Frequency (UHF) and Very HighFrequency (VHF), Ultra Wide Band (UWB) communication and the like, inaddition to the Wi-Fi communication. The access point may extract aposition of a data packet, assign a best communication path for theextracted position, and transfer the data packet to a next device, e.g.,a wearable device 100′, along the assigned communication path. Theaccess point may share several circuits in a general networkenvironment.

The access point is largely classified into a fixed access point and amobile access point. The fixed access point may include a router, arepeater, a relay and the like, and the mobile access point may includea bridge product of a specific manufacturer such as Egg of KTCorporation. Such a mobile access point may read a receiving sideaddress from the transmitting side information and transmit data afterassigning a most suitable communication path while guaranteeing freemobility.

In the present invention, each device or server has a transmission andreception unit, and here, the transmission and reception unit includesan RF transmission means for up-converting the frequency of atransmitted signal and amplifying the signal and an RF reception meansfor low-noise amplifying a received signal and down-converting thefrequency of the received signal. The transmission and reception unitmay include at least one of a wireless communication module (not shown)and a wired communication module (not shown). In addition, the wirelesscommunication module may include at least one of a wireless networkcommunication module, a Wireless Local Area Network, Wireless Fidelityor Worldwide Interoperability for Microwave Access (WLAN, Wi-Fi orWiMAX) communication module and a Wireless Personal Area Network (WPAN)communication module.

The wireless communication module is a configuration for transmittingand receiving data according to a wireless communication method, andwhen a device or a server uses wireless communication, it may transmitor receive data for providing payment information using any one of thewireless network communication module, the wireless LAN communicationmodule and the wireless PAN communication module.

A payment information providing system according to an embodiment of thepresent invention includes a wearable device 100, a product informationproviding device 200 and a contents providing server 300. Morespecifically, the payment information providing system includes: awearable device 100 for recognizing and photographing a product image bysensing a motion of a user and transferring the photographed productimage to a product information providing device 200, and receivingproduct information transferred from the product information providingdevice 200 and displaying the product information on a screen; theproduct information providing device 200 for receiving the product imagefrom the wearable device 100 and providing information on a productrelated to the product image to the wearable device 100; and a contentsproviding server for receiving the product information from the productinformation providing device 200 and transferring digital contents tothe wearable device 100 if a product to be purchased is selectedaccording to the received product information.

Here, of the term ‘digital contents’, the ‘digital’ means a method ofexpressing information, and the ‘contents’ generally refers toinformation, knowledge and database configured in a variety of formssuch as a symbol, a character, a sound, a video, a picture, an image andthe like, and although the digital contents are contents configured inthe form of a character, a sound, a picture, a video and the likedistributed using the Internet, they do not mean only information andsimple contents, but mean contents of a form containing a transactionand a service as a property for creating an added value using variousinformation techniques. For example, the digital contents includeapplications related to a service provided by a service provider, whichcan be transferred to the wearable device 100 or a smart terminal deviceand executed therein, electronic coupons related to a store, electroniccoupons related to membership and the like.

In another embodiment of the present invention, the payment informationproviding system may further include a membership connection device 400.At this point, the membership connection device 400 may performauthentication according to the authentication information transferredfrom the contents providing server 300, transfer membership informationof the user to the contents providing server 300 if it is confirmed thatthe user is a membership holder as a result of the authentication, andtransmit a membership acquisition request message to the contentsproviding server 300 and the wearable device 100 if it is confirmed thatthe user is not a membership holder.

If the payment information providing system includes the membershipconnection device 400, there is an effect of persuading a user toacquire a membership related to an affiliated company which providesdigital contents and a service provider which provides a paymentinformation providing service platform. Meanwhile, such a membershipconnection device 400 is an additional component, and a digital contentsproviding service related to the product information can be directlyprovided to a user without authenticating the membership acquiredthrough the membership connection device 400.

FIG. 2 is a view showing an example of recognizing and photographing aproduct image following the eyeline of a user by a wearable device 100according to an embodiment of the present invention.

If a user gazes at a product through a wearable device 100, the cameramodule 120 of the wearable device 100 may recognize an image of theproduct to which the eyeline of the user moves. At this point, thecamera module 120 preferably means a camera module 120 of a smart glass.

FIG. 3 is a view showing an example of selecting an interested productfollowing a gesture of a user by a wearable device 100 according to anembodiment of the present invention.

For example, when a user takes a gesture of picking up a product whilegazing at the product as shown in the figure, the corresponding productcan be selected.

FIG. 4 is a view showing an example of providing payment information bya payment information providing system according to an embodiment of thepresent invention.

Referring to FIG. 4 , if a user gazes at a product through a wearabledevice 100, the camera module 120 acquires a product image accordingthereto, and the product information providing device 200 transmitsproduct information to the wearable device 100 and a contents providingserver according to the acquired image and provides the wearable device100 with the product information and digital contents according to theproduct image. Like this, the product information and the digitalcontents information may be displayed on the wearable device 100 aspayment information. Meanwhile, the contents providing server 300 andthe wearable device 100 may provide the same information to other smartdevices which can be paired with the wearable device 100 so that theinformation can be displayed on corresponding smart devices.

FIG. 5 is a block diagram showing the configuration of a wearable device100 according to an embodiment of the present invention.

A wearable device 100 according to an embodiment of the presentinvention includes a motion sensing unit 110, a camera module 120, animage storage unit, a product information data reception unit 140 and adisplay unit 150. More specifically, the wearable device 100 includes: amotion sensing unit 110 for sensing a motion of a user; a camera module120 for recognizing and photographing a product image; an image storageunit for storing a product image data of the product image photographedby the camera module 120; an image data transmission unit 130 fortransferring the product image data stored in the image storage unit toa product information providing device 200; a product information datareception unit 140 for receiving product information transferred fromthe product information providing device 200; and a display unit 150 fordisplaying the product information data received by the productinformation data reception unit 140 on a screen.

The motion sensing unit 110 senses a motion of a user. The motion of auser may be the eyeline of the user gazing at a product or a presetgesture performed on the product that the user is gazing at.

For example, if a user wearing the wearable device 100 gazes at aspecific product, the camera module 120 recognizing the gaze onto theproduct may focus on the corresponding product, and the motion sensingunit 110 may sense a gesture of picking up the product or a gesture of afinger pointing at the product from the image of the focused product.

The camera module 120 recognizes and photographs a product image. Atthis point, if the motion of the user sensed by the motion sensing unit110 matches a preset motion, the camera module 120 may recognize andphotograph the product. Photographing a product image may beaccomplished in order of focusing the camera module 120 on a productfollowing the eyeline of the user and photographing the productaccording to a specific gesture or focusing the camera module 120following the eyeline of the user and photographing the product when theuser is gazing at the product for a preset time.

The image storage unit stores the product image data of the productphotographed by the camera module 120. The image storage unit is anapparatus for storing image data, which includes a main memory deviceand an auxiliary memory device, and may store an application programneeded for a functional operation of the wearable device 100 to storeimages. Such an image storage unit may largely include a program areaand a data area. Here, when the wearable device 100 activates eachfunction in response to a request of a user, it provides the functionsby executing corresponding application programs under the control of thecontrol unit. Particularly, the image storage unit according to anembodiment of the present invention may store an operating system forbooting the camera module 120 of the wearable device 100, a program forimage-processing the photographed image and the like.

The image data transmission unit 130 transfers the product image datastored in the image storage unit to the product information providingunit 200.

The product information data reception unit 140 receives productinformation transferred from the product information providing unit 200.

The display unit 150 displays product information data received by thedata reception unit on the screen. The display unit 150 displaysinformation on a series of operation states and operation resultscreated while performing a function of the wearable device 100. Inaddition, the display unit 150 may display a menu of the wearable device100 and user data or the like input by the user. Here, the display unit150 may be configured of a Liquid Crystal Display (LCD), a Thin FilmTransistor LCD (TFT-LCD), Organic Light Emitting Diodes (OLED), LEDs,Active Matrix Organic LEDs (AMOLEDs), a flexible display, athree-dimensional display or the like. At this point, the display unit150 may be configured in the form of a touch screen, and when thedisplay unit 150 is configured in the form of a touch screen like this,the display unit 150 may perform some or all of the functions of aninput unit. Particularly, the display unit 150 according to anembodiment of the present invention displays the product informationdata received from the product information providing device 200 anddigital contents transferred from the contents providing server 300.

Meanwhile, the product information data reception unit 140 may furtherreceive digital contents transferred from the contents providing server300 if a product to be purchased is selected according to the productinformation, and the display unit 150 may display payment information ofthe product reflecting the digital contents received by the productinformation data reception unit 140 on the screen.

Since comprehensive payment information showing payment informationreflecting the digital contents (an electronic coupon) for a product tobe purchased is provided, there is an effect of reasonably selecting aproduct when a user purchases the product.

FIG. 6 is a block diagram showing the configuration of a productinformation providing device 200 according to an embodiment of thepresent invention.

A product information providing device 200 according to an embodiment ofthe present invention includes a data reception unit 210, a productimage database 220, a product image matching unit 230, a productinformation providing module 240 and a product information datatransmission unit. More specifically, the product information providingdevice 200 includes: a data reception unit 210 for receiving a digitalcontents information data or a product image data; a product imagedatabase 220 for storing image data of products displayed in a store; aproduct image matching unit 230 for determining whether or not theproduct image data received from a wearable device 100 by the datareception unit matches a product image data previously stored in theproduct image database 220; a product information providing module 240for providing information on a matching product if it is determined bythe product image matching unit 230 that the product image data of astore stored in the product image database 220 matches the product imagedata received from the wearable device 100; and a product informationdata transmission unit for transferring product information dataprovided by the product information providing module 240 to the wearabledevice 100.

The data reception unit 210 receives a digital contents information dataor a product image data.

The product image database 220 stores product image data of productsdisplayed in a store visited by the user. Here, the database is anapparatus for storing data and basically stores data such asenvironmental variables or the like used for search, classification,analysis and the like, and since the functions of the database can beimplemented using general techniques, detailed descriptions on theimplementation will be omitted.

The product image matching unit 230 determines whether or not theproduct image data received from a wearable device 100 by the datareception unit matches the product image data previously stored in theproduct image database 220.

If it is determined by the product image matching unit 230 that theproduct image data of a store stored in the product image database 220matches the product image data received from the wearable device 100,the product information providing module 240 provides information on amatching product.

Meanwhile, if a matching product image data does not exists, a messagerequesting update of the product image and the product information canbe transferred to the terminal (not shown) of a store manager to receivethe image product and the product information from the store manager.

The product information data transmission unit transfers productinformation data provided by the product information providing module240 to the wearable device 100.

Meanwhile, the product information data transmission unit may furthertransfer the product information data provided by the productinformation providing module 240 to a contents providing server 300.

FIG. 7 is a block diagram showing the configuration of a productinformation providing module 240 according to an embodiment of thepresent invention.

The product information providing module 240 according to an embodimentof the present invention includes a product classification unit 241, aproduct information creation unit 242 and a product data providing unit243. More specifically, the product information providing module 240includes: a product classification unit 241 for classifying, bycategory, a type of a product corresponding to the product image datadetermined as being matched by the product image matching unit 230; aproduct information creation unit 242 for creating a product informationdata of the product classified by category by the product classificationunit 241; and a product data providing unit 243 for transferring theproduct information data of the product created by the productinformation creation unit 242 to the product information datatransmission unit.

The product classification unit 241 classifies a type of a productcorresponding to the product image data determined as being matched bythe product image matching unit 230 by category. Since the products areorganized by the type through the process, product information can becollectively created by category.

The product information creation unit 242 creates a product informationdata of the product classified by category by the product classificationunit 241. At this point, the product information data may include atleast any one of information on a specification of the product, priceinformation, a manufacturing date, a manufacturer and a product providedas a bundle. For example, the specification of the product may includethe size and weight of the product and information on the expiry date,ingredients and the like in the case of a food, and the priceinformation may be information comparing a price of the product, adiscount rate of the product, a discounted price and the like. However,the product information data is not limited thereto and may includevarious kinds of information according to the information input by thestore manager.

Meanwhile, the product information creation unit 242 may additionallycreate a product information data for a product of the same kind as theproduct classified by the product classification unit 241.

For example, a product information data can be additionally created andprovided for a product (e.g., milk B) of the same kind as a product(e.g., milk A) selected by the user. This can be added in response to arequest of a service provider providing the payment information or astore manager, and the user may also create information on a product ofthe same kind if the user agrees to display information on the productof the same kind. Meanwhile, the information created for the product ofthe same kind can be provided to the wearable device 100 or the contentsproviding server 300 together with the information on the selectedproduct. Like this, since other products of the same kind can berecommended by inversely using the information on the product selectedby the user, the service provider or the store manager may utilize thepresent invention for marketing purposes.

Meanwhile, the product information creation unit 242 may create theproduct information data by reflecting the digital contents informationdata transferred from the contents providing server 300.

The product data providing unit 243 transfers the product informationdata of the product created by the product information creation unit 242to the product information data transmission unit.

FIG. 8 is a block diagram showing the configuration of a contentsproviding server 300 according to an embodiment of the presentinvention.

A contents providing server 300 according to an embodiment of thepresent invention includes a product information reception unit, adigital contents providing unit 320 and a digital contents transmissionunit 330. More specifically, the contents providing server 300 includes:a product information reception unit for receiving product informationfrom the product information providing device 200; a digital contentsproviding unit 320 for transferring digital contents related to theproduct information received by the product information reception unitto a digital contents transmission unit 330; and the digital contentstransmission unit 330 for transferring the digital contents transferredfrom the digital contents providing unit 320 to the wearable device 100.

The contents providing server 300 according to an embodiment of thepresent invention may further include an authentication informationtransmission unit 340. The authentication information transmission unit340 transfers authentication information to the membership connectiondevice 400 to confirm whether or not a user holds membership of anaffiliated company or a product service provider related to the digitalcontents transferred from the digital contents providing unit 320 to thewearable device 100.

FIG. 9 is a block diagram showing the configuration of a membershipconnection device 400 according to an embodiment of the presentinvention.

A membership connection device 400 according to an embodiment of thepresent invention includes a membership holder authentication performingunit 410, a membership information transmission unit 420, a membershipacquisition request transmission unit 430 and a membership acquisitionapproval message reception unit 440. More specifically, the membershipconnection device 400 includes: a membership holder authenticationperforming unit 410 for performing authentication according toauthentication information transferred from the contents providingserver 300; a membership information transmission unit 420 fortransferring membership information of a user to the contents providingserver 300 if it is confirmed that the user is a membership holder as aresult of the authentication of the membership holder authenticationperforming unit; a membership acquisition request transmission unit 430for transmitting a membership acquisition request message to thewearable device 100 if it is confirmed that the user is not a membershipholder as a result of the authentication of the membership holderauthentication performing unit; and a membership acquisition approvalmessage reception unit 440 for receiving a membership acquisitionapproval message transmitted from the wearable device 100 in response tothe membership acquisition request message.

The membership holder authentication performing unit 410 performsauthentication according to the authentication information transferredfrom the contents providing server 300. At this point, the phone numberand the name of the user, details of the provided contents and otherdiverse information can be used as the authentication information.

The membership information transmission unit 420 transfers membershipinformation of the user to the contents providing server 300 if it isconfirmed that the user is a membership holder as a result of theauthentication of the membership holder authentication performing unit.If the membership information transmission unit 420 transfers themembership information to the contents providing server 300, thecontents providing server 300 may obtain a right for transferringdigital contents (coupons) to an electronic name card service user.Through the process like this, an effect of persuading the electronicname card service user to subscribe a service of an affiliated companywhich provides corresponding digital contents (coupons) is generated.

If it is confirmed that the user is not a membership holder as a resultof the authentication of the membership holder authentication performingunit, the membership acquisition request transmission unit 430 transmitsa membership acquisition request message to the wearable device 100.

The membership acquisition approval message reception unit 440 receivesa membership acquisition approval message transmitted from the wearabledevice 100 in response to the membership acquisition request message.

Meanwhile, in the present invention, the membership connection device400 is a device (a server) for inducing acquisition of membership, andit is a configuration that can be further included by the need of anelectronic name card service provider or a platform provider.

FIG. 10 is a sequence diagram illustrating a payment informationproviding method using a wearable device 100 according to an embodimentof the present invention.

A method of providing payment information by a payment informationproviding system according to an embodiment of the present inventionincludes the steps of (1) recognizing and photographing a product image(step S1), (2) determining whether or not an image data matches (stepS2), (3) providing product information (step S3), and (4) providingdigital contents (step S4). More specifically, the method of providingpayment information by a payment information providing system includesthe steps of: (1) recognizing and photographing, by a wearable device100, a product image by sensing a motion of a user (step S1); (2)receiving, by a product information providing device 200, the productimage photographed at step (1) and determining whether or not theproduct image matches a product image data previously stored in aproduct image database 220 (step S2); (3) providing an information dataof a matching product if the product image data is matched at step (2)(step S3); and (4) receiving, by a contents providing server 300, theproduct information from the product information providing device 200and transferring digital contents to the wearable device 100 accordingto the received product information (step S4).

FIG. 11 is a sequence diagram illustrating a method of providing paymentinformation by performing an authentication process using a membershipconnection device 400 according to another embodiment of the presentinvention.

Referring to FIG. 11 , in another embodiment of the present invention,the method of providing payment information may further include, afterstep (3) and before step (4), the steps of: (a) confirming, by amembership connection device 400, whether or not a user holds membershipof an affiliated company which provides digital contents usingauthentication information of the service user subscribing a paymentinformation providing service; (b) transferring, by the membershipconnection device 400, membership information of the user to thecontents providing server 300 if it is confirmed that the user is amembership holder at step (a), and transferring a membership acquisitionrequest message to the contents providing server 300 and the wearabledevice 100 if it is confirmed that the user is not a membership holderat step (a); and (c) transferring the membership information of the userto the contents providing server 300 if a membership acquisitionapproval message is transferred from the wearable device 100 in responseto the membership acquisition request message transferred at step (b).

A method of providing payment information by a wearable device 100according to an embodiment of the present invention includes the stepsof: (1) sensing a motion, (2) recognizing and photographing a productimage, (3) storing the photographed image, (4) transmitting informationon the stored image, (5) receiving product information, and (6)displaying the product information and contents information. Morespecifically, the method of providing payment information by a wearabledevice 100 includes: (1) a motion sensing step of sensing a motion of auser; (2) a step of recognizing and photographing a product imageaccording to the motion recognized at step (1); (3) an image storagestep of storing a product image data of the product image photographedat step (2); (4) an information transmission step of transferring theproduct image data stored at step (3) to a product information providingdevice; (5) a data reception step of receiving product informationcorresponding to the product image data transferred at step (4); and (6)a display step of displaying the product information data received atstep (5).

A motion of a user is sensed at step (1). At this point, the motion ofthe user is a preset gesture performed with respect to the eyes of theuser gazing at a product or a product that the user is gazing at, and aproduct can be selected according to various gestures.

At step (2), the camera module 120 recognizing the sensed motion of theuser photographs a product image. Meanwhile, if the motion of the usermatches a preset motion, the camera module 120 may recognize andphotograph the product. At this point, the product image can bephotographed by recognizing the eyes of the user gazing at the product,and on the other hand, according to settings, the product image can bephotographed when a specific gesture is performed together with therecognition of the eyes gazing at the product.

At step (3), the product image data of the product image photographed bythe camera module 120 at step (2) is stored.

At step (4), the product image data is transferred to the productinformation providing device 200 to create product information of aproduct corresponding to the stored product image data.

At step (5), product information corresponding to the transferredproduct image data is received from the product information providingdevice 200.

At step (6), the received product information data is displayed on ascreen.

A method of providing payment information by a product informationproviding device 200 according to an embodiment of the present inventionincludes the steps of: (1) receiving a data, (2) determining whether ornot the image data matches, (3) providing product information, and (4)transmitting product information data. More specifically, the method ofproviding payment information by a product information providing device200 includes: (1) a data reception step of receiving a digital contentsinformation data and a product image data; (2) a step of determiningwhether or not a product image data of a visited store previously storedin a product image database 220 matches the product image data receivedat step (1); (3) a product information providing step of providing, ifit is determined at step (2) that the product image data of a storestored in the product image database 220 matches the product image datareceived from a wearable device 100, an information data of a matchingproduct; and (4) a data transmission step of transferring the productinformation data provided at step (3) to the wearable device 100.

At step (1), a digital contents information data and a product imagedata is received.

At step (2), whether or not a product image data of a visited storepreviously stored in the product image database 220 matches the productimage data received at step (1) is determined.

At step (3), if it is determined at step (2) that the product image dataof a store stored in the product image database 220 matches the productimage data received from the wearable device 100, an information data ofa matching product is provided. At this point, step (3) may furtherinclude: (a) a product classification step of classifying, by category,a type of a product corresponding to the product image data determinedas being matched at step (2); (b) a product information creation step ofcreating a product information data of the product classified bycategory at step (a); and (c) a product data providing step oftransferring the information data of the product created at step (b) toa product information data transmission unit.

At step (4), the product information data provided at step (3) istransferred to the wearable device 100.

Meanwhile, the method of providing payment information may furtherinclude, after step (2) and before step (3), the step of receiving, if amatching product image data does not exist, a product image and productinformation from a product management server.

A method of providing payment information by a contents providing server300 according to an embodiment of the present invention includes: (1) aproduct information reception step, (2) a digital contents providingstep and (3) a digital contents transmission step. More specifically,the method of providing payment information by a contents providingserver 300 includes: (1) a product information reception step ofreceiving product information from a product information providingdevice 200; (2) a digital contents providing step of transferringdigital contents related to the product information received at step (1)to a digital contents transmission unit 330; and (3) a digital contentstransmission step of transferring the digital contents transferred atstep (2) to a wearable device 100.

Meanwhile, the method of providing payment information by a contentsproviding server 300 may further include, after step (2) and before step(3), an authentication information transmission step of transferringauthentication information to a membership connection device 400 toconfirm whether or not a user holds membership of an affiliated companyor a payment information provider related to the digital contents.

A method of providing payment information by a membership connectiondevice 400 according to an embodiment of the present invention includes(1) a membership holder authentication performing step, (2) a membershipacquisition request message transmission step and (3) membershipacquisition approval message receiving step. More specifically, themethod of providing payment information by a membership connectiondevice 400 includes: (1) a membership holder authentication performingstep of performing authentication according to authenticationinformation transferred from a contents providing server 300; (2) a stepof transferring membership information of a user to the contentsproviding server 300 if it is confirmed that the user is a membershipholder as a result of the authentication at step (1) and transmitting amembership acquisition request message to a wearable device 100 if it isconfirmed that the user is not a membership holder; and (3) a membershipacquisition approval message receiving step of receiving a membershipacquisition approval message transmitted from the wearable device 100 inresponse to the membership acquisition request message transmitted atstep (2).

Like this, according to the present invention, payment information of aproduct can be provided promptly and correctly in real-time byrecognizing a product image and creating product information using awearable device 100, and a service associated with digital contents canbe provided in real-time using the product information.

In addition, a custom-tailored product is provided to the user byinversely using the information collected using the wearable device 100,and a digital contents service associated with the product can beprovided.

A service providing method using such a payment information providingsystem can be created as a computer program, and codes and code segmentsconstituting the computer program may be easily reasoned by a programmerin the art. In addition, the program related to the payment informationproviding method using a payment information providing system is storedin an information storage medium that can be read by an electronicdevice and can be read and executed by the electronic device.

FIG. 12 is a configuration view showing the functional blocks of asystem for providing coupons and points by sensing a payment motionaccording to an embodiment of the present invention.

Referring to FIG. 12 , a system for providing coupons and points bysensing a payment motion according to an embodiment of the presentinvention includes a wearable device 100′ and a product informationproviding device 200′. More specifically, the system for providingcoupons and points by sensing a payment motion includes: a wearabledevice for storing one or more payment motions of a user, sensing amotion of the user, grasping whether or not the sensed motion of theuser matches the stored payment motion, and requesting information oncoupons, points or events that can be used at a store where the user ispositioned from a product information providing device if the motionsare matched; and a product information providing device for storing theinformation on coupons, points or events that can be used at a store,extracting information on coupons, points or events that can be used ata store where the user is positioned, and transmitting the extractedinformation to the wearable device in response to a request from thewearable device.

A wearable device 100′ is literally a device that can be put on a humanbody, and there are various kinds of wearable devices according towearing portions, such as glasses, a watch, shoes, a ring, a belt, aband, a necklace, a headset, clothes and the like.

Meanwhile, construction of a system capable of making a payment througha wearable device 100′ emerges as a main issue in the related industriesrecently. For example, although a user does not take out his or herwallet and make a payment, the user may make a payment through awearable device 100′ by installing a near field communication (NFC)function in the wearable device 100′ itself and registering a creditcard and authentication information of the user in an application. Thatis, the wearable device may perform a mobile wallet function on behalfof conventional wallets. However, since there are a lot of problemsrelated to security, such as personal information of a user, approval ofcard payment and the like, there are a lot of technical problems to besolved.

Particularly, when a user makes a payment at a certain store, there is aproblem in that the user does not remember all the information oncoupons, points or events that can be used at a corresponding store,they should be searched for through an application or the like.

Accordingly, the wearable device 100′ of the present invention is toprovide convenience of payment by sensing that a user is going to make apayment by recognizing a payment motion without a physical input of theuser and receiving information on coupons, points or events that can beused at a store where the user is positioned on the basis of positioninformation of the user.

To this end, the wearable device 100′ of the present invention mounts asensor for sensing a motion of a user and analyzes movement of musclesof the user or specific motions performed by the user. For example, whenthe user takes a motion of picking up a card, the wearable device 100′senses that the muscles of the thumb and the index finger are used morethan a predetermined strength, and if this is a previously storedpayment motion of the user, it is recognized as a motion of the usergoing to make a payment, and the wearable device may transmitinformation on the store where the user is positioned to the productinformation providing device 200′ and receive information on coupons,points or events handled at the store where the user is positioned.

The product information providing device 200′ may collect information onthe user, information on the store where the user is positioned and thelike received from the wearable device 100′ and transmit appropriateinformation to the user. More specifically, the product informationproviding device 200′ may transmit information such as a menu of a storefor ordering, coupons usable at the store, points usable at the store,events progressed at the store and the like to the wearable device 100′of the user or the user terminal 400′.

Meanwhile, the wearable device 100′ or the user terminal 400′ describedbelow and the product information providing device 200′ are preferablyconnected through a wired and wireless network. The communicationnetwork includes a base station controller, a base station transmitterand/or a relay. Here, the base station controller performs a function ofrelaying signals between the base station transmitter and a switchingcenter. The communication network supports both synchronous andasynchronous types. Accordingly, in the case of the synchronous type,the transmitter of a transmission and reception base station will be aBase Station Transmission System (BTS), and the controller of thetransmission and reception base station will be a Base StationController (BSC), whereas in the case of the asynchronous type, thetransmitter of a transmission and reception base station will be a RadioTransceiver Subsystem (RTS), and the controller of the transmission andreception base station will be a Radio Network Controller (RNC). It isapparent that the communication network according to an embodiment ofthe present invention is not limited thereto, and it generally refers toa GSM network, not a CDMA network, and any one that can be used in anaccess network of a next-generation mobile communication system whichwill be implemented in the future.

The communication network may further include access points. The accesspoint is a small base station such as a femto or pico base stationfrequently installed inside a building. Here, the femto or pico basestation is categorized by the maximum number of wearable devices 100′ oruser terminals 400′ based on the classification of small base stations.In addition, the access point includes a short-range communicationmodule for performing short-range communication with the wearabledevices 100′ or the user terminals 400′, such as Wi-Fi communication orthe like. The short-range communication can be performed based onvarious specifications of Bluetooth communication, Zigbee communication,infrared communication (IrDA), Radio Frequency (RF) communicationincluding Ultra High Frequency (UHF) and Very High Frequency (VHF),Ultra Wide Band (UWB) communication and the like, in addition to theWi-Fi communication. The access point may extract a position of a datapacket, assign a best communication path for the extracted position, andtransfer the data packet to a next device, e.g., a wearable device 100′or a user terminal 400′, along the assigned communication path. Theaccess point may share several circuits in a general networkenvironment.

The access point is largely classified into a fixed access point and amobile access point. The fixed access point may include a router, arepeater, a relay and the like, and the mobile access point may includea bridge product of a specific manufacturer such as Egg of KTCorporation. Such a mobile access point may read a receiving sideaddress from the transmitting side information and transmit data afterassigning a most suitable communication path while guaranteeing freemobility.

As another embodiment of the present invention, the system for providingcoupons and points by sensing a payment motion may further include abeacon 300′ for sensing approach of the wearable device 100′ andtransmitting position information of a store to the wearable device 100′approached within a predetermined distance, and the wearable device 100′transmits the position information of the store received from the beacon300′ to the product information providing device 200′ and receivesinformation on coupons, points or events that can be used at the sorefrom the product information providing device 200′.

The beacon 300′ is a means for sending a signal to a wearable device100′ or a user terminal 400′ of a user within a short distance(approximately 50 to 70 m) to inform position information or the like ofthe user, and it is a technique in which the beacon 300′ installed in astore periodically sends an ID and a Received Signal Strength Indicator(RSSI) value as a signal and receives information if the user of thewearable device 100′ or the user terminal 400′ enters within the rangeof the signal. The beacon 300′ functions as a reference point forinforming a position, uses a communication technique such as DedicatedShort Range Communication (DSRC), ultrasonic wave, infrared ray,Bluetooth, CDMA, LTE, WiFi, LiFi or the like to transfer information,and is classified into a sound-based low frequency beacon 300′, an LEDbeacon 300′, a Wi-Fi beacon 300′, a Bluetooth beacon 300′ and the like.Particularly, the present invention may use a short-range wirelesscommunication based on the Bluetooth Low Energy (BLE) protocol.Therefore, although it is difficult to grasp an indoor position usingthe GPS, the beacon 300′ is advantageous in that information on a storewhere a user is positioned can be confirmed correctly since the beacon300′ makes it possible to grasp the position of an indoor userpositioned within the range of radius.

Accordingly, when a user of the present invention enters a store inwhich a beacon 300′ is installed, the beacon 300′ sends an ID containingposition information of the store to the wearable device 100′, and thewearable device 100′ transmits the position information of thecorresponding store to the product information providing device 200′ sothat the product information providing device 200′ may transmitinformation on coupons, points or events that can be used by the user atthe corresponding store.

As another embodiment of the present invention, the system for providingcoupons and points by sensing a payment motion may further include auser terminal 400′ for receiving information on coupons, points orevents from the product information providing device 200′ and making amobile payment by reflecting the information on coupons, points orevents. Therefore, payments can be made through the user terminal 400such as a smart phone or the like used by the user himself or herself,as well as the wearable device 100′.

Here, the user terminal 400′ includes a Personal Digital Assistant(PDA), a smart phone, a cellular phone, a Personal Communication Service(PCS) phone, a Global System for Mobile (GSM) phone, a Wideband CDMA(W-CDMA) phone, a CDMA-2000 phone, a Mobile Broadband System (MBS) phoneand the like which can be applied in a variety of wired and wirelessenvironments. On the other hand, although the user terminal 400′ mayrepresent a small portable device, embodiments of the present inventionwill not be specially limited thereto since the user terminal can bereferred to as a mobile communication terminal if the user terminalincludes a camcorder, a laptop computer or the like.

FIG. 13 is a configuration view showing the functional blocks of awearable device 100′ for providing coupons and points by sensing apayment motion according to an embodiment of the present invention.

Referring to FIG. 13 , a wearable device 100′ for providing coupons andpoints by sensing a payment motion according to an embodiment of thepresent invention may include: a motion storage unit 110′ for storingone or more payment motions of a user; a motion sensing unit 120′ forsensing a motion of the user; and a control unit 130′ for graspingwhether or not the sensed motion of the user matches the stored paymentmotion and, if the motions are matched, requesting information oncoupons, points or events that can be used at a store where the user ispositioned from a product information providing device.

The motion storage unit 110′ may store one or more payment motionsdesired by a user to be assigned as payment motions in the wearabledevice 100′. In addition, to recognize the motions, the motion sensingunit 120′ described below recognizes motions of the user and stores themotions in the motion storage unit 110′. For example, the motion sensingunit 120′ which will be described below may sense the speed and angle ofmoving an arm when the user takes bills or a card out of a wallet bynarrowing a thumb and an index finger and store the motion in the motionstorage unit 110′.

The motion sensing unit 120′ senses a motion of the user, and at thispoint, the motion includes motions from a minute motion to a big motionof all means of the body of the user. For example, if the wearabledevice 100′ is a smart glass, it may sense specific movements of theeyes of the user as a motion, and if the wearable device 100′ is a smartwatch or a smart band, it may sense movements of the fingers or the palmof the user through muscles or nerves, and if the wearable device 100′is a smart ring put on a finger, it may sense a motion through thechange of moving direction and acceleration of the finger when the usertakes a motion of drawing a specific picture using the finger.Meanwhile, the embodiments described above are merely examples, andvarious means, other than these, for sensing a motion of the user can beincluded.

At this point, as an embodiment of the present invention, the motionsensing unit 120′ may use an electromyography sensor for sensing anelectrical signal of a muscle changing according to a motion of theuser. A wearable device 100′, such as a smart watch or a smart band puton a part of the body in which muscles briskly move, preferably uses theelectromyography sensor. The electromyography sensor may grasp a motionof the user by grasping contraction and relaxation states of muscles ofthe user.

For example, since the muscles used when the user moves fingers aredifferent from each other, the electromyography sensor may graspmovement of each finger, and since a motion also can be sensed through acombination of the fingers, as the electromyography sensor sensesvarious motions, the control unit 130′ described below may issue acommand corresponding to the motion.

In addition, as another embodiment of the present invention, the motionsensing unit 120′ may use an inertial sensor for sensing an accelerationchanging according to a motion of the user. The inertial sensor detectsan inertial force generated according to the movement of the body afterthe user wears the wearable device 100′ and detects an inertial forceacting on an inertial object by measuring an acceleration, i.e., aspeed, a direction, a distance or the like, of a body portion moved bythe user. The inertial sensor is classified into an accelerometer and agyroscope, and development of inertial sensors using a laser andnon-mechanical type inertial sensors are also under progress.

When a motion sensing unit 120′ using such an inertial sensor is used,an example assuming that the wearable device 100′ is a smart ring put ona finger can be considered. At this point, when the user takes a motionof drawing a specific picture, the motion can be sensed through changeof direction and acceleration.

For example, if the user draws ‘ON’ in the air using a finger wearing asmart ring, the motion sensing unit 120′ senses such a motion of theuser, and the control unit 130′ described below searches for a motionmatching to the motion of the user among the previously stored paymentmotions. If the motion of the user matches a payment motion, the controlunit 130′ described below requests information on coupons, points orevents that can be used at a store where the user is positioned from theproduct information providing device, and the product informationproviding device transmits the information to the wearable device, andthus the user may conveniently receive and use the information oncoupons, points or events that can be used at a store where the user ispositioned without a physical input.

If whether or not the sensed motion of the user matches the previouslystored payment motion is grasped and the motions are matched, thecontrol unit 130′ may request information on coupons, points or eventsthat can be used at a store where the user is positioned from theproduct information providing device.

For example, if the user draws ‘OK’ in the air or draws ‘O’ by narrowinga thumb and an index finger, the motion sensing unit 120′ senses such amotion of the user, and the control unit 130′ searches for a motionmatching to the motion of the user among the payment motions previouslystored in the motion storage unit 110′. If the motion of the user is apayment motion, the control unit 130′ requests information on coupons,points or events that can be used at a store where the user ispositioned from the product information providing device.

In addition, the control unit 130′ may make a payment by transmittingthe payment information of the user previously stored in the wearabledevice 100′ to an external device. Here, the payment informationincludes information selected by the user as a payment means, and forexample, when the user make a payment using credit card information, thepayment information includes a company, a card number, an expiry dateand a CVC number related to the credit card, and it is preferred thatthe payment information is previously stored in the wearable device100′.

As an embodiment of progressing a payment, as the user takes a paymentmotion, the control unit 130′ transmits a signal containing paymentinformation of the user to a POS terminal of the store through awireless communication, and if information on an amount to be paid istransmitted from the POS terminal, the control unit 130′ may approve theamount through a previously stored motion in the wearable device 100′itself. With regard to such a payment approval motion, the final paymentapproval can be accomplished by distinguishing the user through a meanssuch as vein authentication or the like through the wearable device100′.

Here, the POS is an acronym of point-of-sale, and a POS terminal is aterminal device installed at a cash register of a store or the like toinput sale information of a product on each occasion and transmit thesale information to a central computer by way of a communication link.Although a general configuration of the POS terminal is marking inadvance a type, a price and the like of a product on a price tag assymbols, reading the symbols using a reader or the like and summarizingsale information, in the present invention, it is preferable towirelessly transmit and receive payment information of the user orinformation on an amount to be paid at the store to and from thewearable device 100′ or the user terminal 400′.

In addition, as an embodiment of granting a final approval by the userterminal 400′, rather than the wearable device 100′, the amount to bepaid that the wearable device 100′ has received from the POS terminal inthe previous embodiment is transmitted to the user terminal 400′ so thata payment screen for displaying the payment amount and the informationon coupons, points or events that can be used at the corresponding storemay displayed on the user terminal 400′. Then, the final paymentapproval can be granted using a means such as fingerprint authenticationor the like for the security of the user.

As another embodiment of the present invention, a wearable device 100′for providing coupons and points by sensing a payment motion accordingto another embodiment of the present invention may further include acommunication unit 140′ for transmitting a signal created by the controlunit 130′ to the product information providing device 200′ together withGPS information through a communication network and receivinginformation on coupons, points or events of the store based on the GPSinformation from the product information providing device 200′. Here,the communication network includes both wired communication and wirelesscommunication, and the wearable device 100′ for providing coupons andpoints by sensing a payment motion and the product information providingdevice 200′ may be connected to each other through the communicationnetwork.

At this point, the communication unit 140′ receives position informationof the store from the beacon 300′, transmits the position information ofthe store received from the beacon 300′ to the product informationproviding device 200′, and receives information on coupons, points orevents that can be used at the store from the product informationproviding device 200′. Although it is difficult to grasp an indoorposition using the GPS, the beacon 300′ is advantageous in thatinformation on the store where the user is positioned can be confirmedcorrectly since the beacon 300′ makes it possible to grasp the positionof an indoor user positioned within the range of radius.

Accordingly, when a user of the present invention enters a store inwhich the beacon 300′ is installed, the beacon 300′ sends an IDcontaining information on the position of the store to the wearabledevice 100′, and the wearable device 100′ transmits the positioninformation of the corresponding store to the product informationproviding device 200′, and the product information providing device 200′may transmit information on coupons, points or events that can be usedby the user at the corresponding store.

In addition, if information related to the payment at the store such ascoupons, points or events is received from the product informationproviding device 200′, the control unit 130′ makes a payment bytransmitting payment information of the user reflecting the receivedinformation on coupons, points or events to an external device.

For example, the user may request payment information of the user andinformation on an amount to be paid at the POS terminal of the store byapplying a discount coupon, a one-plus-one promotion coupon or the likereceived from the product information providing device 200′ or applyingaccumulated points that can be used at the store, or the user mayreceive information on an event progressed at the store and requestinformation on an amount to be paid at the POS terminal of the storeafter participating in the corresponding event.

FIG. 14 is a view showing the functional blocks of a product informationproviding device 200′ according to an embodiment of the presentinvention.

Referring to FIG. 14 , a product information providing device 200′according to an embodiment of the present invention includes a database210′, a server control unit 220′ and a server communication unit 230′.More specifically, the product information providing device 200′includes: a database 210′ for storing information on coupons, points orevents that can be used at a store; a server control unit 220′ forextracting information corresponding to a signal received from awearable device 100′ from the database 210′; and a server communicationunit 230′ for transmitting the corresponding information to the wearabledevice 100′ or a user terminal 400′.

The database 210′ may receive position information of the user from thewearable device 100′ and store various kinds of information that can beused at a store used by the user, such as user information (membershipinformation of the user, frequently used stores, information on a storethat has approved inquiry of the user information, etc.), information oncoupons that can be used at a specific store, information on pointaccumulation of the user at each store, information on events progressedat a store and the like, and the database 210′ may update information ifnew information is received from the wearable device 100′ or an externaldevice. Here, the database 210′ is an apparatus for storing data andbasically stores data such as environmental variables or the like usedfor search, classification, analysis and the like, and since thefunctions of the database 210′ can be implemented using generaltechniques, detailed descriptions on the implementation will be omitted.

The server control unit 220′ may extract information corresponding to asignal received from the wearable device 100′ from the database 210′.For example, if the information received from the wearable device 100′is a signal requesting information on coupons that can be used at the‘Daechi-long branch of store A’, the control unit 130′ may search forcoupons that can be used at the store A and transmit the coupons to thewearable device 100′ or a user terminal 400′ of a user using an ID thesame as that of the wearable device 100′.

The server communication unit 230′ may transmit the correspondinginformation extracted from the database 210′ by the server control unit220′ according to a request signal of the wearable device 100′ to thewearable device 100′ or the user terminal 400′ through a communicationnetwork. Here, the communication network includes both wiredcommunication and wireless communication, and the wearable device 100′and the product information providing device 200′ may be connected toeach other through the communication network.

FIG. 15 is a view showing the sequence diagram of a method of making apayment by sensing a motion according to an embodiment of the presentinvention.

Referring to FIG. 15 , a method of making a payment by sensing a motionaccording to an embodiment of the present invention includes the stepsof: (a) sensing, by a wearable device, a motion of a user (step S410′);(b) comparing, by the wearable device, the motion of the user with apreviously stored motion and creating a signal set to execute a commandcorresponding to a previously stored payment motion (step S420′); (c)transmitting, by the wearable device, the signal to a productinformation providing device and receiving, by a management server, thesignal (step S430′); (d) extracting, by the product informationproviding device, information corresponding to the received signal (stepS440′); (e) transmitting, by the product information providing device,the extracted information to the wearable device and receiving, by thewearable device, the extracted information (step S450′); and (f) makinga payment, by the wearable device, by transmitting payment informationof the user reflecting the received information to an external device(step S460′).

At step (a) (step S410′), the wearable device 100′ analyzes movement ofmuscles of a user or a specific motion performed by the user using asensor for sensing a motion of the user. For example, it may be set suchthat when the user takes a motion of completely folding a thumb, thewearable device senses that the muscles using the thumb of the user areused more than a predetermined strength and turns on the screen, andwhen the user takes a motion of folding an index finger, the wearabledevice may transmit payment information of the user to a paymentterminal of the store where the user is positioned so that the user maymake a payment for a specific product. In addition, when the user takesa motion of folding a middle finger, the wearable device may transmitinformation on the store where the user is positioned to the productinformation providing device and receive information on coupons, pointsor events handled at the store where the user is positioned.

At step (b) (step S420′), the wearable device 100′ searches for amatching motion by comparing the motion sensed at step (a) (step S410′)with a previously stored motion, and if this is a motion for making apayment by the user, the wearable device 100′ may make a payment bytransmitting previously stored payment information of the user to the anexternal device. Here, the payment information includes informationselected by the user as a payment means, and for example, when the usermake a payment using credit card information, the payment informationincludes a company, a card number, an expiry date and a CVC numberrelated to the credit card, and it is preferred that the paymentinformation is previously stored in the wearable device 100′.

At step (c) (step S430′), the wearable device 100′ for providing couponsand points by sensing a payment motion and the product informationproviding device 200′ may be connected to each other through acommunication network, and the communication network includes both wiredcommunication and wireless communication.

At step (d) (step S440′), the product information providing device 200′extracts information corresponding to the signal received from thewearable device 100′. For example, if the information received from thewearable device 100′ is a signal requesting information on coupons thatcan be used at the ‘Daechi-dong branch of store A’, the productinformation providing device 200′ may search for coupons that can beused at store A and transmit information on the coupons to the wearabledevice 100′ or a user terminal 400′ of a user using an ID the same asthat of the wearable device 100′.

At step (e) (step S450′), the wearable device 100′ for providing couponsand points by sensing a payment motion and the product informationproviding device 200′ may be connected to each other through acommunication network, and the communication network includes both wiredcommunication and wireless communication.

At step (f) (step S460′), the wearable device 100′ may make a payment bytransmitting the payment information of the user reflecting theinformation on coupons, points or events received from the productinformation providing device 200′ to an external device.

As another embodiment of the present invention, the method of making apayment by sensing a motion according to another embodiment of thepresent invention may further include, before step (c) (step S430′), thestep of receiving, by the wearable device 100′, position information ofthe store from a beacon 300′ (step S470′), and at step (c) (step S430′),the received position information of the store is also transmitted tothe product information providing device 200′. Meanwhile, the step ofreceiving position information of the store from the beacon 300′ willnot be limited between specific steps from the aspect of time series.

Accordingly, when a user of the present invention enters a store inwhich the beacon 300′ is installed, the beacon 300′ sends an IDcontaining information on the position of the store to the wearabledevice 100′, and the wearable device 100′ transmits the positioninformation of the corresponding store to the product informationproviding device 200′, and the product information providing device 200′may transmit information on coupons, points or events that can be usedby the user at the corresponding store. Therefore, although it isdifficult to grasp an indoor position using the GPS, the beacon 300′ isadvantageous in that information on a store where the user is positionedcan be confirmed correctly since the beacon 300′ makes it possible tograsp the position of an indoor user positioned within the range ofradius.

As another embodiment of the present invention, the method of making apayment by sensing a motion according to another embodiment of thepresent invention may further include, after step (d) (step S440′), thesteps of: (d1) transmitting, by the management server, the extractedinformation to the user terminal and receiving, by the user terminal,the information (step S480′); and (d2) making, by the user device, apayment by transmitting the payment information of the user reflectingthe received information to an external device (step S490′). Therefore,a payment can be made through the user terminal 400 such as a smartphone or the like used by the user himself or herself, as well as thewearable device 100′.

Here, the user terminal 400′ includes a Personal Digital Assistant(PDA), a smart phone, a cellular phone, a Personal Communication Service(PCS) phone, a Global System for Mobile (GSM) phone, a Wideband CDMA(W-CDMA) phone, a CDMA-2000 phone, a Mobile Broadband System (MBS) phoneand the like which can be applied in a variety of wired and wirelessenvironments. Meanwhile, although the user terminal 400′ may represent asmall portable device, embodiments of the present invention will not bespecially limited thereto since the user terminal can be referred to asa mobile communication terminal if the user terminal includes acamcorder, a laptop computer or the like.

FIG. 16 is a view showing the flowchart of a method of making a paymentby sensing a motion in a method of making a payment by sensing a motionby a wearable device according to an embodiment of the presentinvention.

Referring to FIG. 16 , in a method of making a payment by sensing amotion by a wearable device, the method of making a payment by sensing amotion according to an embodiment of the present invention includes thesteps of: (a) storing one or more payment motions of a user (stepS510′); (b) sensing a motion of the user (step S520′); (c) graspingwhether or not the sensed motion of the user matches the stored paymentmotion (step S530′); and (d) requesting, if the sensed motion of theuser matches the stored payment motion, information on coupons, pointsor events that can be used at a store where the user is positioned froma product information providing device (step S540′).

At step (b) (step S520′), the wearable device senses a motion of theuser, and at this point, the motion includes motions from a minutemotion to a big motion of all means of the body of the user. Forexample, if the wearable device 100′ is a smart glass, it may sensespecific movements of the eyes of the user as a motion, and if thewearable device 100′ is a smart watch or a smart band, it may sensemovements of fingers or the palm of the user through muscles or nerves,and if the wearable device 100′ is a smart ring put on a finger, it maysense a motion through the change of moving direction and accelerationof the finger when the user takes a motion of drawing a specific pictureusing the finger. Meanwhile, the embodiments described above are merelyexamples, and various means, other than these, for sensing a motion ofthe user can be included.

At this point, as an embodiment of the present invention, at step (b)(step S520′), the wearable device may use an electromyography sensor forsensing an electrical signal of a muscle changing according to a motionof the user. A wearable device 100′, such as a smart watch or a smartband put on a part of the body in which muscles briskly move, preferablyuses the electromyography sensor. The electromyography sensor may graspa motion of the user by grasping contraction and relaxation states ofmuscles of the user.

For example, since the muscles used when the user moves fingers aredifferent from each other, the electromyography sensor may graspmovement of each finger, and since a motion also can be sensed through acombination of the fingers, as the electromyography sensor sensesvarious motions, the control unit 130′ described below may issue acommand corresponding to the motion.

In addition, as another embodiment of the present invention, at step (b)(step S520′), the wearable device may use an inertial sensor for sensingan acceleration changing according to a motion of the user. The inertialsensor detects an inertial force generated according to the movement ofthe body after the user wears the wearable device 100′ and detects aninertial force acting on an inertial object by measuring anacceleration, i.e., a speed, a direction, a distance or the like, of abody portion moved by the user. The inertial sensor is classified intoan accelerometer and a gyroscope, and development of inertial sensorsusing a laser and non-mechanical type inertial sensors are also underprogress.

When such an inertial sensor is used, an example assuming that thewearable device 100′ is a smart ring put on a finger can be considered.At this point, when the user takes a motion of drawing a specificpicture, the motion can be sensed through change of direction andacceleration.

Step (d) (step S540′) may include the steps of: (d1) transmitting, ifthe sensed motion of the user matches the stored payment motion, thecreated payment signal to the product information providing devicetogether with GPS information; and (d2) receiving information oncoupons, points or events based on the GPS information from the productinformation providing device. Therefore, in the present invention, aposition of a store where a user is positioned can be grasped based onthe GPS information, and various kinds of information handled at thecorresponding store can be received from the product informationproviding device 200′.

FIG. 17 is a view showing the flowchart of a method of making a paymentby sensing a motion in a method of making a payment by sensing a motionby a wearable device according to another embodiment of the presentinvention.

Referring to FIG. 17 , a method of making a payment by sensing a motionaccording to another embodiment of the present invention includes thesteps of: (a) storing one or more payment motions of a user (stepS610′); (b) sensing a motion of the user (step S620′); (c) graspingwhether or not the sensed motion of the user matches the stored paymentmotion (step S630′); and (d) requesting, if the sensed motion of theuser matches the stored payment motion, information on coupons, pointsor events that can be used at a store where the user is positioned froma product information providing device, and in addition, the methodfurther includes the step of (e) receiving position information of thestore from a beacon (step S640′), and step (d) may include the steps of:(d3) transmitting the position information of the store to the productinformation providing device (step S650′); and (d4) receivinginformation on coupons, points or events that can be used at the storefrom the product information providing device (step S660′). Meanwhile,step (e) will not be limited between specific steps from the aspect oftime series.

In addition, the method of making a payment by sensing a motion of thepresent invention may further include, after step (d) (steps S650′ andS660′), the step of making a payment by transmitting the paymentinformation of the user reflecting the information on coupons, points orevents received from the product information providing device to anexternal device (step S670′).

Accordingly, when a user of the present invention enters a store inwhich the beacon 300′ is installed, the beacon 300′ sends an IDcontaining information on the position of the store to the wearabledevice 100′, and the wearable device 100′ transmits the positioninformation of the corresponding store to the product informationproviding device 200′, and the product information providing device 200′may transmit information on coupons, points or events that can be usedby the user at the corresponding store.

FIG. 18 is a view showing the flowchart of a method of making a paymentby sensing a motion in a method of making a payment by sensing a motionby a product information providing device according to an embodiment ofthe present invention.

Referring to FIG. 18 , in a method of making a payment by sensing amotion by a product information providing device, the method of making apayment by sensing a motion according to an embodiment of the presentinvention includes the steps of: (a) storing information on coupons,points or events that can be used at a store (step S710′); (b)extracting information corresponding to a signal received from awearable device (step S720′); and (c) transmitting the correspondinginformation to the wearable device or a user terminal (step S730′).

At step (a) (step S710′), the database 210′ may receive positioninformation of the user from the wearable device 100′ and store variouskinds of information that can be used at a store used by the user, suchas user information (membership information of the user, frequently usedstores, information on a store that has approved inquiry of the userinformation, etc.), information on coupons that can be used at aspecific store, information on point accumulation of the user at eachstore, information on events progressed at a store and the like, and thedatabase 210′ may update information if new information is received fromthe wearable device 100′ or an external device. Here, the database 210′is an apparatus for storing data and basically stores data such asenvironmental variables or the like used for search, classification,analysis and the like, and since the functions of the database 210′ canbe implemented using general techniques, detailed descriptions on theimplementation will be omitted.

At step (b) (step S720′), the product information providing device 200′may extract information corresponding to the signal received from thewearable device 100′, and for example, if the information received fromthe wearable device 100′ is a signal requesting information on couponsthat can be used at the ‘Daechi-long branch of store A’, the controlunit 130′ may search for coupons that can be used at store A andtransmit information on the coupons to the wearable device 100′ or auser terminal 400′ of a user using an ID the same as that of thewearable device 100′.

At step (c) (step S730′), the product information providing device 200′may transmit the corresponding information extracted from the database210′ by the server control unit 220′ according to a request signal ofthe wearable device 100′ to the wearable device 100′ or the userterminal 400′ through a communication network. Here, the communicationnetwork includes both wired communication and wireless communication,and the wearable device 100′ and the product information providingdevice 200′ may be connected to each other through the communicationnetwork.

FIG. 19 is a view showing a system for providing benefit information foran interested product according to an embodiment of the presentinvention, FIG. 20 is a view showing an example of implementing awearable device as a smart glass according to an embodiment of thepresent invention, and FIG. 21 is a view showing an example ofimplementing a wearable device as a smart watch according to anembodiment of the present invention.

Referring to FIG. 19 , a system for providing benefit information for aninterested product includes a wearable device 100″ and a productinformation providing device 200″, and they are connected through acommunication network.

The wearable device 100″ displays an image corresponding to a view of auser on a screen, and if the user performs a preset motion, the wearabledevice 100″ identifies an object from the displayed image, registers theidentified object as an interested product, and receives benefitinformation corresponding to a category where the interested productbelongs to from the product information providing device 200″. Here, thepreset motion is, for example, a motion of picking up an object, and thewearable device 100″ is provided with a function of sensing a motion ofthe user and determines whether or not the sensed motion is a presetmotion.

According to the type of the wearable device 100″, the wearable device100″ uses a different method of sensing a motion of the user. If thewearable device 100″ is a smart glass, movement of the eyes of the usermay be sensed as a motion, and if the wearable device 100″ is a smartwatch or a smart band, movement of the body (e.g., an arm or a hand) ofthe user may be sensed as a motion. Meanwhile, the embodiments describedabove are merely examples, and various means, other than these, forsensing a motion of the user can be included.

In addition, the wearable device 100″ used in the present invention isprovided with a photographing function and acquires an imagecorresponding to a view of the user.

An application (or an applet) capable of performing a benefitinformation providing service for an interested product can be stored inthe wearable device 100″, and benefit information provided by theproduct information providing device 200″ can be output through theapplication.

Here, the wearable device 100″ may be any one of a smart watch, a smartglass and a smart band. First, it will be described focusing on the casewhere the wearable device 100″ is a smart glass.

A user wears a smart glass on the face and performs a motion such aspurchasing a product, eye shopping or the like in an offline space. Atthis point, the user wears the smart glass so that the smart glass mayexactly face the front side and accurately recognize a product image.For example, as shown in FIG. 21 , if a user wearing a smart glass 100″picks up a product 300″, the smart glass 100″ displays the product 300″picked up by the user on the screen, and if the exposure time of thedisplayed product is longer than a preset time, the smart glass 100″registers the picked up product 300″ as an interested product, receivesbenefit information corresponding to a category where the interestedproduct belongs to, and displays the benefit information on the screen.

Such a wearable device 100″ will be described in detail with referenceto FIG. 22 .

If information on an interested product is received from the wearabledevice 100″, the product information providing device 200″ determines acategory of the interested product and provides the wearable device 100″with benefit information of the products belonging to the category.Here, the category may be a category of a brand, a manufacturer, a typeor the like, and the benefit information may be a coupon, a discount, amembership service, product information or the like, and the productinformation may include a product name, a store name, a store location,a store phone number, a store description and the like. For example, if‘Product A’ is a one-piece suit (clothes) of brand A, the productinformation providing device 200″ may determine the category of ‘ProductA’ as ‘Brand A’ or ‘One-piece’ and provide benefit information of theproducts belonging to the category of ‘Brand A’ or provide benefitinformation of the products belonging to the category of ‘One-piece’.

On the other hand, the product information providing device 200″ may beimplemented as a single arithmetic unit or may be implemented in theform of an aggregated device connecting two or more arithmetic units.

The product information providing device 200″ will be described indetail with reference to FIG. 23 .

In the above descriptions, the wearable device 100″ is provided with adisplay unit and may display an image photographed by the wearabledevice 100″, benefit information transmitted from the productinformation providing device 200″ and the like. However, the wearabledevice 100″ may not be provided with a display unit. In this case, theinterested product information providing system may further include auser device (not shown).

As another embodiment of the present invention, the system for providingbenefit information for an interested product may further include a userdevice (not shown) for storing and outputting an image photographed bythe wearable device 100″, benefit information transmitted from theproduct information providing device 200″ and the like. At this point,the wearable device 100″ and the user device may be paired with eachother through short-range wireless communication.

The wearable device 100″ may transmit a photographed image and benefitinformation transmitted from the product information providing device200″ to a user device (e.g., a smart phone) paired with the wearabledevice 100″. For example, the wearable device 100″ may transmit andreceive data using a short-range communication network such as NFC orBluetooth. At this point, the wearable device 100″ may transmitinterested product information from the user device to the productinformation providing device 200″ through the short-range communicationnetwork. The wearable device 100″ may receive benefit information of theinterested product created by the product information providing device200″ from the product information providing device 200″ and transmit thereceived benefit information of the interested product from the wearabledevice 100″ to the user device.

The user device includes a Personal Digital Assistant (PDA), a smartphone, a cellular phone, a Personal Communication Service (PCS) phone, aGlobal System for Mobile (GSM) phone, a Wideband CDMA (W-CDMA) phone, aCDMA-2000 phone, a Mobile Broadband System (MBS) phone and the likewhich can be applied in a variety of wired and wireless environments.Here, although the user device may represent a small portable device,embodiments of the present invention will not be specially limitedthereto since the user terminal can be referred to as a mobilecommunication terminal if the user terminal includes a camcorder, alaptop computer or the like.

Meanwhile, the wearable device 100″ for providing benefit informationservice for an interested product according to an embodiment of thepresent invention may be implemented through a smart watch, a smart bandor the like, as well as the smart glass described above. Hereinafter, adifference of implementing the wearable device 100″ through a smartwatch, a smart band or the like, not the smart glass, will be described.

When the wearable device 100″ for providing benefit information servicefor an interested product is implemented through a smart watch, althoughthe user looks at with eyes a product that the user is interested in, itis difficult for the smart watch to recognize whether or not the productis an interested product as is in the case of a smart glass since thesmart watch is put on the wrist of the user. Accordingly, although thefunctions of the smart watch are the same as those of the smart glass,it is preferable to set an image acquisition unit (e.g., a camera) ofthe smart watch 100″ to face an interested product 300″ as shown in FIG.21 and recognize the interested product 300″ using an image acquiredthrough the image acquisition unit when the user performs a presetmotion. In the case of a smart watch, the size of the display unit islimited by the nature of a device such as a watch. In this case,although an image corresponding to a view of the user is acquiredthrough the smart watch, the displayed information may be output througha smart glass or a user device.

On the other hand, in the case of a smart band, although the user looksat with eyes a product that the user is interested in, it is difficultfor the smart band to recognize whether or not the product is aninterested product as is in the case of a smart glass since the smartband is also put on the wrist of the user like the smart watch.Accordingly, it is preferable to set an image acquisition unit to face aproduct like the smart watch and recognize the product using an imageacquired through the image acquisition unit when the user performs apreset motion. In addition, since most of smart bands do not have adisplay unit, there is no way but to provide a photographed image inassociation with other devices. Here, the other devices may be awearable device such as a smart watch or a smart glass, or any otherdevices including a display unit will do although it is nota wearabledevice.

FIG. 22 is a block diagram schematically showing the configuration of awearable device according to an embodiment of the present invention.

Referring to FIG. 22 , a wearable device 100″ includes an imageacquisition unit 110″, a motion sensing unit 120″, a control unit 130″,a display unit 140″, a storage unit 150″ and a communication unit 160″,and apparently, other configurations needed to accomplish other objectsof the present invention can be added.

The image acquisition unit 110″ is a configuration for acquiring animage corresponding to a view of a user and may be, for example, acamera.

The image acquisition unit 110″ may photograph an image on the frontside, which is recognized by the sense of sight of the user inaccordance with the eyeline of the user wearing the wearable device100″.

In addition, if a motion of the user sensed by the motion sensing unit120″ matches a preset motion, the image acquisition unit 110″ mayrecognize and photograph an object. Here, the preset motion may be amotion of picking up an object (e.g., a product).

The image acquisition unit 110″ is implemented as an image acquisitionmeans such as a camera and acquires an image of a product that the useris interested in as an image signal. In some cases, the imageacquisition unit 110″ may be provided with a plurality of cameras andacquire an eyeball image of the user, as well as an image of a productthat the user is looking at. The eyeball image of the user is acquiredto determine which area the user intensively observes among thesurrounding environments. Meanwhile, the image acquired by an imagesensor of the image acquisition unit 110″ in the photographing mode maybe displayed through the display unit 140′.

The motion sensing unit 120″ senses a motion of a user wearing thewearable device 100″. Here, the motion of a user may include the eyelineof the user gazing at an object (a product) or a motion performed on theproduct (e.g., a motion of picking up the object) that the user isgazing at.

According to the type of the wearable device 100″, the motion sensingunit 120″ uses a different method of sensing a motion of the user.

For example, if the wearable device 100″ is a smart glass, the motionsensing unit 120″ may sense movement of the eyes of the user as amotion. At this point, the motion sensing unit 120″ may be a sensorprovided along the center of the frame of the display unit 140″ to traceand recognize the eyeline of the user. In addition, the motion sensingunit 120″ may not be provided along the frame of the display unit 140″and can be mounted at any portion if it is a certain position in thedisplay unit 140″ which can easily trace the eyeline of the user.

In addition, if the wearable device 100″ is a smart watch or a smartband, the motion sensing unit 120″ may sense movement of the body (e.g.,an arm or a hand) of the user as a motion. At this point, the motionsensing unit 120″ may be implemented in a variety of motion recognitionsensors such as an electromyography sensor for sensing an electricalsignal of a muscle changing according to a motion of the user, aninertial sensor for sensing an acceleration changing according to amotion of the user and the like. The electromyography sensor maydetermine a motion of the user by grasping contraction and relaxationstates of muscles of the user. For example, since the muscles used whenthe user moves an arm or a hand are different from each other, theelectromyography sensor may grasp movement of the arm or the hand andsense a motion of the user through the movement of the arm or the hand.The inertial sensor detects an inertial force generated according to themovement of an arm or a hand and detects an inertial force acting on aninertial object by measuring an acceleration, i.e., a speed, adirection, a distance or the like, of a body portion moved by the user.

The display unit 140″ displays the image acquired by the imageacquisition unit 110″.

In addition, the display unit 140″ may display benefit informationreceived from the product information providing device through thecommunication unit 160″.

Such a display unit 140″ may be configured to include a transparent orlight transmissive unit so that the user may see the front view spreadahead, together with the information displayed by the wearable device100″. The display unit 140″ may be implemented using a transparentdisplay method such as a Head Mounted Display (HMD), a Head Up Display(HUD) or a Transparent OLED (TOLED) so that the user may visuallyrecognize an object displayed through the display unit 140″, togetherwith the front view spread ahead. In addition, the display unit 140″ isprovided with a glass screen or the like at a location the same as thatof a smart glass lens, in addition to the frame of the smart glass.

If the motion of the user sensed by the motion sensing unit 120″ is apreset motion, the control unit 130″ identifies an object from the imagedisplayed on the display unit 140″, registers the identified object asan interested product, and receives benefit information corresponding toa category where the interested product belongs to.

That is, the control unit 130″ determines whether or not the motion ofthe user sensed by the motion sensing unit 120″″ is a motion of pickingup an object. At this point, according to the type of the wearabledevice 100″, the control unit 130″ uses a different method ofdetermining whether or not the motion of the user is a motion of pickingup an object.

For example, if the wearable device 100″ is a smart glass, the controlunit 130″ may determine that the user performs a motion of picking up anobject if there is no change in the movement of the eyeline sensed bythe motion sensing unit 120″. In this case, if the user sees the objectwith interest, there is no change in the movement of pupils, and thusthe control unit 130″ may determine that the user performs a motion ofpicking up an object if there is no change in the movement of theeyeline. In addition, the control unit 130″ measures a distance betweena real object focused by the eyeline sensed by the motion sensing unit120″ and the object displayed on the display unit 140″, and if themeasured distance is within a predetermined distance, the control unit130″ may determine that the user performs a motion of picking up theobject. At this point, in order to measure the distance between theobjects, various conventional techniques such as a distance measurementalgorithm and the like can be used. The predetermined distance may be anaverage distance or the like between the eyes of the user and an objectwhen the user picks up the object.

In addition, if the wearable device 100″ is a smart watch or a smartband, the control unit 130″ may determine whether or not movement of anarm or a hand sensed by the motion sensing unit 120″ is a motion ofpicking up an object displayed on the display unit 140″. For example,since the muscles used when the user moves an arm and a finger aredifferent from each other, the motion recognition sensors may graspmovement of the arm and the finger, and the motion of the user may bedetermined as a motion of picking up an object through the movement ofthe arm and the finger.

If the motion of the user is a motion of picking up an object, thecontrol unit 130″ identifies the object from the image displayed on thedisplay unit 140″. At this point, the control unit 130″ may identify theobject by using a method using a difference image, a meanshift andapplication method, a local binary pattern method or the like. Inaddition, the control unit 130″ detects major areas containing an objectand blank areas which are not a major area by analyzing the imagedisplayed on the display unit 140″. The control unit 130″ may detect theobject contained in the image in a variety of conventional methods.

If an object is identified from the image, the control unit 130″registers the object as an interested product and receives benefitinformation corresponding to a category where the interested productbelongs to. That is, if an object is identified from the image, thecontrol unit 130″ extracts product identification information which canspecify the object (a product) by analyzing the identified object image.At this point, the control unit 130″ may extract the productidentification information by using a variety of image analysis logicsuch as an Optical Character Reader (OCR) technique or the like, and theproduct identification information is a medium containing informationwhich can specify the product and includes a product name printed on thewrap of the product, an image of the product or a product package, aQuick Response (QR) code, a bar code, a logo, a label, a brand, amanufacturer, a type and the like. Then, control unit 130″ transmitsinterested product information including the product identificationinformation to the product information providing device and receivesbenefit information corresponding to a category where the correspondingproduct belongs to from the product information providing device. Atthis point, the control unit 130″ receives benefit information of theproducts belonging to at least any one of categories among the brand,the manufacturer and the type the same as that of the correspondingproduct. Here, the benefit information may include a coupon, a discount,a membership service, product information and the like.

For example, if an image acquired through the image acquisition unit110″ includes ‘Product A’ and the product identification information of‘Product A’ includes ‘Product A’, ‘Brand A’, ‘Blouse’ and the like, thecontrol unit 130″ may receive benefit information of the productsbelonging to category ‘Brand A’ or benefit information of the productsbelonging to category ‘Top’ including Blouse.

In the above descriptions, although the control unit 130″ extractsproduct identification information which can specify an object (aproduct) by analyzing an identified object image, the control unit 130″may transmit the object image as is to the product information providingdevice without extracting the product identification information byanalyzing the object image. In this case, the control unit 130″ maytransmit an image including an object and receive benefit informationcorresponding to a category where the corresponding product belongs tofrom the product information providing device.

According to another embodiment of the present invention, the controlunit 130″ may measure an exposure time of the object displayed on thedisplay unit 140″ as soon as a motion of the user is determined as amotion of picking up the object, and if the measured exposure time islonger than a preset time, the control unit 130″ may register theidentified object as an interested product. If the user holds theproduct only for an extremely short time (e.g., one second) and puts itback to its original place, it probably may not be an interestedproduct, and thus the control unit 130″ may measure an exposure time ofthe object as soon as the user performs a motion of picking up theobject and register the object as an interested product only when theexposure time is longer than a preset time.

The control unit 130″ extracts product identification information whichcan specify an object (a product) exposed on the display unit 140″ morethan a preset time by analyzing the object image. At this point, thecontrol unit 130″ may extract the product identification information byusing a variety of image analysis logic. Then, the control unit 130″transmits interested product information including the exposure time andthe product identification information to the product informationproviding device and receives benefit information of the productscorresponding to a category where the corresponding product belongs tofrom the product information providing device. In addition, the controlunit 130″ may transmit an object image exposed more than a preset timeto the product information providing device as is without extracting theproduct identification information by analyzing the object image. Inthis case, the control unit 130″ transmits interested productinformation including the exposure time and the product identificationinformation to the product information providing device and receivesbenefit information of the products corresponding to a category wherethe corresponding product belongs to from the product informationproviding device.

The control unit 130″ may store an application (or an applet) capable ofperforming a benefit information providing service for the interestedproduct and control to output benefit information provided by a serviceserver by driving the application.

The control unit 160 is a configuration for controlling operation ofvarious constitutional components of the wearable device 100″ includingthe image acquisition unit 110″, the motion sensing unit 120″, thedisplay unit 140″, the storage unit 150″ and the communication unit160″.

Such a control unit 130″ may include at least one arithmetic unit, and,here, the arithmetic unit may be a general-purpose central processingunit (CPU), a programmable device element (CPLD or FPGA) implemented tobe suitable for a specific purpose, an application specific integratedcircuit (ASIC) or a microcontroller chip.

The storage unit 150″ is a configuration for storing data related tooperation of the wearable device 100″. Here, the storage unit 150″ mayuse a publicized storage medium and may use one or more of publicizedstorage media such as ROM, PROM, EPROM, EEPROM, RAM and the like.Particularly, interested product information, benefit information andthe like are stored in the storage unit 150″.

An application (or an applet) or the like capable of performing abenefit information providing service for the interested productsintegrated and managed by the control unit 130″ can be stored in thestorage unit 150″, and the stored information can be selected by thecontrol unit 130″ as needed.

The communication unit 160″ is a configuration for exchanging data withvarious electronic devices. Particularly, the communication unit 160″can be connected two or more devices and transmit and receive variouskinds of information such as interested product information, benefitinformation and the like.

In addition, the wearable device 100″ according to the present inventionmay further include a power supply unit (not shown) for supplying power.In addition, the wearable device 100″ of the present invention mayfurther include a short-range communication unit (not shown) forperforming short-range wireless communication with a user terminalpossessed by a user. The short-range communication unit may operateaccording to various specifications such as Wi-Fi, Bluetoothcommunication, Zigbee communication, infrared communication (IrDA),Radio Frequency (RF) communication including Ultra High Frequency (UHF)communication and Very High Frequency (VHF) communication, Ultra WideBand (UWB) communication and the like.

FIG. 23 is a block diagram schematically showing the configuration of aproduct information providing device according to an embodiment of thepresent invention.

Referring to FIG. 23 , a product information providing device 200″includes a database 210″, a communication unit 220″, a personalizedservice unit 230″ and a control unit 240′.

The communication unit 220″ may receive interested product informationfrom a wearable device through a communication network and transmitbenefit information created by the personalized service unit 230″ to thewearable device. Here, the communication network includes both wiredcommunication and wireless communication, and the wearable device andthe product information providing device 200″ may be connected to eachother through the communication network.

Such a data communication unit 220″ may include a variety of wired orwireless communication modules and transmit and receive data accordingto various wireless or wired communication specifications. For example,the data communication unit 220″ can be implemented in a form includingvarious standard communication modules of ITU, IEEE, ISO, IEC and thelike or in a form including a variety of communication modules otherthan the standard communication modules.

The database 210″ includes a product database and a user database.

The product database stores product related information includes aproduct name, a product image, an image of the product package, a QuickResponse (QR) code, a bar code, a logo, a label, a brand, amanufacturer, a category and the like. At this point, the productdatabase is classified by category, and product information is stored bythe category. Here, the category is based on a brand, a type and thelike, and the brand may be a form such as Brand A, Brand B, Brand C andthe like, and the type may be a form such as clothes, healthy food,cooked food, household items and the like.

In addition, the product database stores a variety of benefitinformation such as a coupon, a discount, a membership service and thelike of each product.

The user database stores user information, interested productinformation, preferred brands, preferred products, information onproduct purchase description and the like, and the user information mayinclude a user name, an address, a phone number and the like.

These databases 210″ can be implemented to meet the objects of thepresent invention using a relational database management system (RDBMS)such as Oracle, Infomix, Sybase, DB2 or the like or an object-orienteddatabase management system (OODBMS) such as Gemston, Orion, O2 or thelike and may include appropriate fields to accomplish their functions.

Although it is shown in the figure that the database 210″ is included inthe product information providing device 200″, the database 210″ may beconfigured to be separate from the product information providing device200″ according to the needs of those skilled in the art implementing thepresent invention.

If interested product information is received from the wearable devicethrough the communication unit 220″, the personalized service unit 230″determines a category where an interested product belongs to andprovides the wearable device with benefit information of the productsbelonging to the category. The interested product information mayinclude product identification information, an exposure time, an objectimage and the like, and the personalized service unit 230″ may determinea brand or a type of a corresponding product, a preferred brand of acorresponding product and the like as the category of the product.

If interested product information including product identificationinformation is received from the wearable device, the personalizedservice unit 230″ searches the product database and confirms a categorywhere the product identification information belongs to. For example, ifthe product identification information includes a product name such as‘Product A’, the personalized service unit 230″ searches the productdatabase and confirms a brand (‘Brand A’) or a type (‘Clothes’) that‘Product A’ belongs to and may determine the confirmed ‘Brand A’ or‘Clothes’ as the category of ‘Product A’. In addition, if the productidentification information includes Bar code B, the personalized serviceunit 230″ searches the product database and confirms a brand (‘Brand B’)or a type (‘Healthy food’) where ‘Bar code B’ belongs to and maydetermine the confirmed ‘Brand B’ or ‘Healthy food’ as the category of‘Product B’.

Then, the personalized service unit 230″ provides the wearable devicewith benefit information of the products belonging to the confirmedcategory. That is, the personalized service unit 230″ confirms productsfor which benefits such as a coupon, a discount, a membership and thelike are provided among the products belonging to the confirmed categoryand provides the wearable device with benefit information of theproducts. For example, if ‘Product A’ is a blouse of brand A, thepersonalized service unit 230″ may determine ‘Brand A’ or ‘Top(Clothes)’ as the category of ‘Product A’ and provide benefitinformation of the products belonging to category ‘Brand A’ or benefitinformation of the products belonging to category ‘Top (Clothes)’.

In addition, if interested product information including productidentification information is received, the personalized service unit230″ may search the user database and confirm a preferred brand for aproduct corresponding to the product identification information, acquirebenefit information of the products belonging to the confirmed preferredbrand and provide the benefit information to the wearable device.

In addition, if interested product information including an object imageis received, the personalized service unit 230″ extracts productidentification information which can specify an object (a product) byanalyzing the object image. At this point, the personalized service unit230″ may extract product identification information by using a varietyof image analysis logic such as an Optical Character Reader (OCR)technique or the like, and the product identification information is amedium containing information which can specify the product and includesa product name printed on the wrap of the product, an image of theproduct or a product package, a Quick Response (QR) code, a bar code, alogo, a label, a brand, a manufacturer, a type and the like. Then, thepersonalized service unit 230″ searches the product database, confirms acategory where the product identification information belongs to, andprovides the wearable device with benefit information of the productsbelonging to the confirmed category.

According to another embodiment of the present invention, thepersonalized service unit 230″ may register interested products of theuser based on product purchase description registered in the userdatabase. Then, if benefits such as a discount, a coupon and the likefor the products registered as an interested product are registered, thepersonalized service unit 230″ may inform the user of benefitinformation of the interested products. In addition, the personalizedservice unit 230″ may confirm a category including the productsregistered as an interested product and inform the user of the benefitinformation of the products belonging to the confirmed category.

Meanwhile, the personalized service unit 230″ may be implemented by aprocessor or the like needed to execute a program on a computing device.Like this, the personalized service unit 230″ may be implemented by aphysically independent configuration or implemented in a formfunctionally separated within a processor.

The control unit 240′ is a configuration for controlling operation ofvarious constitutional components of the product information providingdevice 200″ including the communication unit 220″, the database 210″ andthe personalized service unit 230″.

Such a control unit 240′ may include at least one arithmetic unit, and,here, the arithmetic unit may be a general-purpose central processingunit (CPU), a programmable device element (CPLD or FPGA) implemented tobe suitable for a specific purpose, an application specific integratedcircuit (ASIC) or a microcontroller chip.

FIG. 24 is a flowchart illustrating a method of receiving benefitinformation for an interested product by a wearable device according toanother embodiment of the present invention.

Referring to FIG. 24 , a wearable device recognizes an imagecorresponding to a view of a user (step S602), senses a motion of theuser (step S604) and determines whether or not the sensed motion of theuser is a preset motion (step S606). Here, the preset motion may be amotion of picking up an object by the user.

If the sensed motion of the user is a preset motion as a result of thedetermination at step S606, the wearable device identifies an objectfrom the recognized image (step S608) and registers the identifiedobject as an interested product (step S610). At this point, the wearabledevice may identify the object by using a method using a differenceimage, a meanshift and application method, a local binary pattern methodor the like. If an object is identified, the wearable device measures anexposure time of the identified object, and if the measured exposuretime is longer than a preset time, the wearable device may register theobject as an interested product.

After performing step S610, the wearable device receives benefitinformation corresponding to a category where the interested productbelongs to from the product information providing device (step S612).

FIG. 25 is a flowchart illustrating a method of providing benefitinformation for an interested product according to an embodiment of thepresent invention.

Referring to FIG. 25 , a wearable device acquires an image correspondingto a view of a user and displays the image on a screen (step S702),senses a motion of the user (step S704) and determines whether or notthe sensed motion of the user is a preset motion (step S706). Here, thepreset motion may be, for example, a motion of picking up an object bythe user.

If the sensed motion of the user is a preset motion as a result of thedetermination at step S706, the wearable device identifies an objectfrom the displayed image (step S708). At this point, the wearable devicemay identify the object by using a method using a difference image, ameanshift and application method, a local binary pattern method or thelike.

Then, the wearable device measures an exposure time of the identifiedobject (step S710), and if the measured exposure time is longer than apreset time (step S712), the wearable device extracts productidentification information by scanning the object (step S714). At thispoint, the wearable device may extract product identificationinformation by using a variety of image analysis logic such as anOptical Character Reader (OCR) technique or the like, and the productidentification information is a medium containing information which canspecify the product and includes a product name printed on the wrap ofthe product, an image of the product or a product package, a QuickResponse (QR) code, a bar code, a logo, a label, a brand, amanufacturer, a type and the like. The wearable device may store theextracted product identification information, the exposure time, theobject image and the like.

Then, the wearable device transmits interested product informationincluding the exposure time and the product identification informationto the product information providing device (step S716).

The product information providing device extracts the productidentification information from the interested product information anddetermines a category where a product corresponding to the extractedproduct identification information belongs to (step S718). At thispoint, the product information providing device may determine a brand ora type of a corresponding product, a preferred brand of a correspondingproduct and the like as the category of the product.

Then, the product information providing device creates benefitinformation of the products belonging to the determined category (stepS720) and transmits the created benefit information to the wearabledevice (step S722). That is, the product information providing deviceconfirms products for which benefits such as a coupon, a discount, amembership and the like are provided among the products belonging to thedetermined category and provides the wearable device with benefitinformation of the products in the form of a push message.

Then, the wearable device displays the benefit information received fromthe product information providing device (step S724).

FIG. 26 is a flowchart illustrating a method of providing benefitinformation for an interested product according to another embodiment ofthe present invention.

Referring to FIG. 26 , a wearable device acquires an image correspondingto a view of a user and displays the image on a screen (step S802),senses a motion of the user (step S804) and determines whether or notthe sensed motion of the user is a preset motion (step S806). Here, thepreset motion may be, for example, a motion of picking up an object bythe user.

If the sensed motion of the user is a preset motion as a result of thedetermination at step S806, the wearable device identifies an objectfrom the displayed image (step S808).

Then, the wearable device measures an exposure time of the identifiedobject (step S810), and if the measured exposure time is longer than apreset time (step S812), the wearable device transmits interestedproduct information including the exposure time and the acquired imageto the product information providing device (step S814).

The product information providing device acquires product identificationinformation by scanning the received image (step S816) and determines acategory where a product corresponding to the acquired productidentification information belongs to (step S818). At this point, theproduct information providing device determines a brand or a type of acorresponding product, a preferred brand of a corresponding product andthe like as the category of the product.

Then, the product information providing device creates benefitinformation of the products belonging to the determined category (stepS820) and transmits the created benefit information to the wearabledevice (step S822). At this point, the product information providingdevice may transmit the benefit information in the form of a pushmessage.

Then, the wearable device displays the benefit information received fromthe product information providing device (step S824).

The method of providing benefit information for an interested productaccording to another embodiment of the present invention may be mountedas a function basically provided by a wearable device, morespecifically, a smart glass. In addition, the method of providingbenefit information for an interested product according to anotherembodiment of the present invention may be implemented in the form of aprogram and, in this state, stored in a computer-readable recordingmedium, in which programs to be executed in a computer are recorded, ordistributed through a program providing server.

Like this, those skilled in the art may recognize that the presentinvention can be embodied in other specific forms without departing fromthe spirit and essential characteristics of the present invention.Therefore, it should be understood that the embodiments described aboveare illustrative and not restrictive to limit the scope. In addition,the flowcharts in the figures show sequential orders exemplarily shownto achieve the most desirable results in implementing the presentinvention, and it is apparent that other additional steps can beprovided or some steps can be deleted.

Technical features described in this specification and implementationsexecuting the features can be implemented in digital electroniccircuitry, or in computer software, firmware or hardware including thestructures disclosed in this specification and their structuralequivalents, or in combinations of one or more of them. In addition, theimplementations executing the features described in this specificationcan be implemented as one or more computer program products, i.e., oneor more modules of computer program instructions encoded on a tangibleprogram carrier for execution by, or to control the operation of, a dataprocessing device.

A computer-readable medium can be a machine-readable storage device, amachine-readable storage substrate, a memory device, a composition ofmatter effecting a machine-readable propagated signal, or anycombination thereof.

The term “device” or “system” in the specification encompasses allinstruments, devices and machines for processing data, including aprocessor, a computer or multiple processors or computers. Theprocessing system may include, in addition to hardware, a code thatcreates an execution environment for the computer program if requested,e.g., a code constituting processor firmware, a protocol stack, adatabase management system, an operating system, or any combinationthereof.

A computer program also referred to as a program, software, a softwareapplication, a script or a code can be written in any form ofprogramming language including compiled or interpreted languages, ordeclarative or procedural languages, and can be implemented in any formincluding as a standalone program or a module, a component, a subroutineor other units suitable for use in a computing environment.

Meanwhile, a computer program does not necessarily correspond to a filein a file system. A program can be stored in a single file or multiplecoordinated files (e.g., files that store one or more modules,sub-programs, or portions of a code) provided in the requested programor in a portion of a file that holds other programs or data (e.g., oneor more scripts stored in a markup language document).

A computer program can be implemented to be executed on multiplecomputers or one or more computers located at one site or distributedacross multiple sites and interconnected by a wired/wirelesscommunication network.

Meanwhile, the computer-readable media suitable for storing computerprograms, instructions and data may include all forms of non-volatilememory, media and memory devices including by way of examplesemiconductor memory devices, e.g., EPROM, EEPROM, and flash memorydevices; magnetic disks, e.g., internal hard disks or external disks;magneto-optical disks; and CD and DVD disks. Further, the processor andmemory can be supplemented by, or incorporated in, special purpose logiccircuitry.

The implementations executing the features described in thisspecification can be implemented in a computing system that includes aback end component, e.g., a data server, or that includes a middlewarecomponent, e.g., an application server, or that includes a front endcomponent, e.g., a client computer having a Web browser or a graphicaluser interface through which a user can interact with an implementationof the subject matter described in this specification, or anycombination of one or more of the back end, middleware or front endcomponents. The components of the system can be interconnected by anyform or medium of digital data communication, e.g., a communicationnetwork.

Hereinafter, a further specific embodiment for implementingconfigurations including the system described in this specificationtogether with the above-described contents and an MO (mobile originated)service-based benefic providing method will be described in detail.

The system and the service providing method using a payment informationproviding system described in this specification may be partially orentirely used through a means executing computer software, program codesor instructions on a server related to a client device or a web-basedstorage system or one or more processors included in the server.

Here, the processor may be part of a computing platform such as aserver, a client, a network infrastructure, a mobile computing platform,a fixed computing platform or the like, and specifically, it can be akind of a computer or a processing device which can execute programinstructions, codes or the like.

In addition, the processor may further include memory for storing theservice providing method using a payment information providing system,instructions, codes and programs, and if the memory is not included, theprocessor may access, through a separate interface, a storage devicesuch as a CD-ROM, a DVD, memory, a hard disk, a flash drive, RAM, ROMcache or the like in which the service providing method using a paymentinformation providing system, instructions, codes and programs arestored.

In addition, the system and the service providing method using a paymentinformation providing system described in this specification may bepartially or entirely used through a machine that executes computersoftware on a server, a client, a gateway, a hub, a router or networkhardware.

Here, the software may be executed in various kinds of servers such as afile server, a print server, a domain server, an Internet server, anIntranet server, a host server, a distributed server and the like, andthe servers may further include memories, processors, computer-readablestorage media, storage media, communication devices, ports, clients andinterfaces capable of accessing other servers through a wired/wirelessnetwork.

The service providing method using a payment information providingsystem, instructions, codes and the like also can be executed by aserver, and other devices required for execution of the serviceproviding method using a payment information providing system can beimplemented as a part of a hierarchical structure associated with theserver.

In addition, the server may provide an interface to other devicesincluding, without limitation, clients, other servers, printers,database servers, print servers, file servers, communication servers,distributed servers and the like, and a connection through the interfacemay facilitate remote execution of a program through a wired/wirelessnetwork.

In addition, any one of the devices attached to the server through aninterface may further include at least one storage device capable ofstoring the service providing method using a payment informationproviding system, instructions, codes and the like, and the centralprocessor of the server may provide the device with instructions, codesand the like to be executed on different devices to be stored in thestorage device.

On the other hand, the system and the service providing method using apayment information providing system described in this specification maybe partially or entirely used through a network infrastructure.

Here, the network infrastructure may include all of devices such ascomputing devices, servers, routers, hubs, firewalls, clients, personalcomputers, communication devices, routing devices and the like, separatemodules capable of executing each of the functions and the like and mayfurther include a storage medium such as flash memory, a buffer, astack, RAM, ROM and the like in addition to the devices and modulesmention above. In addition, the service providing method using a paymentinformation providing system, instructions, codes and the like also canbe executed and stored by any one of the devices, modules and storagemedia included in the network infrastructure, and other devices neededto execute the service providing method using a payment informationproviding system also can be implemented as a part of the networkinfrastructure.

In addition, the system and the service providing method using a paymentinformation providing system described in this specification may beimplemented in hardware or a combination of hardware and softwaresuitable for a particular application.

Here, the hardware may include all of general purpose computer devicessuch as a personal computer, a mobile communication device and the likeand specific computer devices for enterprise, and the computer devicemay be implemented as a device including memory, microprocessors,microcontrollers, digital signal processors, application integratedcircuits, programmable gate arrays, programmable array logic and thelike or a combination thereof.

The computer software, instructions, program codes and the likedescribed above may be stored or accessed by a readable device. Here,the readable device may include memory such as: computer components thatretains digital data used for computing for some interval of time;semiconductor storage such as RAM or ROM; permanent storage such asoptical disks; mass storage such as hard disks, tapes, drums or thelike; optical storage such as CD or DVD; computer-detachable massstorage such as flash memory, floppy disks, magnetic tapes, paper tapes,standalone RAM disks or the like; network connection storage such asdynamic memory, static memory, variable storage or clouds, and the like.

Meanwhile, although the instructions, codes or the like include all thelanguages including data-oriented languages (e.g., SQL, dBase), systemlanguages (e.g., C, Objective-C, C++, Assembly), architectural languages(e.g., Java, .NET), and application languages (e.g., PHP, Ruby, Perl,Python), they are not limited thereto and include all other languagesknown to those of skill in the art.

In addition, the term “computer-readable medium” described in thisspecification includes all the media contributing to providinginstructions for execution of a program to a processor. Specifically,the medium includes, but not limited to, non-volatile media such as datastorage devices, optical disks, magnetic disks and the like, volatilemedia such as dynamic memory and the like, and transmission media suchas coaxial cables, copper wires, fiber optics and the like fortransmitting data.

Meanwhile, the elements executing the technical features of the presentinvention, which are included in the block diagrams and flowcharts shownin the drawings attached to this specification, imply logical boundariesbetween the elements.

However, according to software or hardware embodiments, since thedepicted elements and the functions thereof may be executed in the formof a standalone software module, a monolithic software structure, acode, a service and a combination of these and stored in a mediumexecutable in a computer provided with a processor capable of executingstored program codes, instructions and the like to implement theirfunctions, all such implementations may be regarded as being includedwithin the scope of the present invention.

Thus, while the attached drawings and descriptions thereof set forthtechnical features of the present invention, no particular arrangementof software for implementing these functional aspects should be inferredfrom these descriptions unless explicitly stated or otherwise clear fromthe context. That is, there may exist various embodiments describedabove, and since part of the embodiments can be modified whilepossessing technical features the same as those of the presentinvention, all the modifications should be regarded as being includedwithin the scope of the present invention.

While operations are depicted in the drawings in a particular order,this is shown to achieve the most desirable results should not beconstrued as requiring that such operations should be performed in theparticular order shown or in a sequential order or that all theillustrated operations should be performed. In certain circumstances,multitasking and parallel processing may be advantageous.

Moreover, separation of various system components in the embodimentsdescribed above should not be understood as requiring such separation inall embodiments, and it should be understood that the described programcomponents and systems can generally be integrated together in a singlesoftware product or packaged into multiple software products.

As described above, this specification is not intended to limit thepresent invention by the proposed specific terms. Accordingly, althoughthe present invention has been described in detail with reference to theembodiments described above, those skilled in the art may makealterations, changes and modifications on the embodiments withoutdeparting from the scope of the present invention.

The scope of the present invention is represented by the claims to bedescribed below rather than the detailed description, and it is to beinterpreted that the meaning and scope of the claims and all the changesor modified forms derived from the equivalents thereof come within thescope of the present invention.

According to the present invention, payment information of a product canbe provided promptly and correctly in real-time by recognizing a productimage and creating product information using a wearable device 100.

In addition, an advantageous effect in marketing can be obtained byproviding a service associated with digital contents in real-time usingthe product information.

In addition, an advantageous effect in marketing can be obtained byproviding a custom-tailored product to a user by inversely using theinformation collected using a wearable device and providing a digitalcontents service associated with the product.

In the present invention, information on coupons, points or events thatcan be used at a store where a user is going to make a payment can bereceived without a physical input by sensing a payment motion of theuser.

In addition, the present invention increases convenience of a user bysensing a payment motion of a user without a special input andprogressing a payment at a store.

In addition, a wearable device transmits a position of a user to aproduct information providing device, receives information on coupons,points or events of an affiliated store, and provides paymentinformation reflecting the received information to a terminal of thestore so that the user may make a payment.

According to the present invention, since information on a productreviewed by a user with interest, as well as a product actuallypurchased by the user, is collected and the product is registered as aninterested product, a user may be provided with information on a productalthough the user does not purchase the product.

In addition, purchase of an interested product can be induced byrecommending benefit information such as a discount, a coupon,membership or the like of the products belonging to a category of aproduct registered as an interested product.

In addition, in the present invention, although a wearable device isinside a building, information on a store can be confirmed correctly bya beacon, and thus information on a coupon, a discount or an event of acorresponding store can be provided from a product information providingdevice.

The effects of the present invention are not limited to the effectsmentioned above, and various effects can be included within the scopeclearly understood by those skilled in the art from the abovedescriptions.

What is claimed is:
 1. A wearable device comprising: a camera moduleconfigured to selectively capture an image of a physical product forwhich product information is to be presented to a user; a display screenconfigured to display the image of the physical product to the userresponsive to capturing the image; a ring for wearing on a finger of theuser configured to sense a hand gesture of the user on the physicalproduct subsequent to presenting the image to the user; and a controlunit configured to process payment on the physical product responsive toat least sensing the hand gesture by the ring.
 2. The device accordingto claim 1, wherein the ring comprises an electromyography sensor forsensing an electrical signal of a muscle changing according to the handgesture.
 3. The device according to claim 1, wherein the ring comprisesan inertial sensor for sensing an acceleration of the ring changingaccording to the hand gesture of the user.
 4. The device according toclaim 1, further comprising a communication unit configured to transmita request generated by the control unit to a computing device togetherwith position information and receiving information on coupons, pointsor events of a store in which the physical product is located based onthe position information from the computing device.
 5. The deviceaccording to claim 4, wherein the communication unit is configured to:receive the position information of the store from a beacon, transmitthe position information of the store received from the beacon to aproduct information providing device, and receive the information oncoupons, points or events applicable to the physical product from thecomputing device.
 6. The device according to claim 1, wherein thecontrol unit is further configured to perform optical character readingon the captured image.
 7. The device according to claim 1, furthercomprising a motion storage unit for storing one or more payment motionsof the user including the hand gesture.
 8. The device according to claim1, wherein the camera module is configured to capture the image of thephysical product detecting the user gazing at the physical product for apredetermined amount of time and sensing a motion of the user by thering.
 9. The device according to claim 8, wherein the sensed motion ispicking up of the physical product.
 10. The device according to claim 8,wherein the sensed motion is moving of an arm or a finger with thephysical product.